-- Logs begin at Wed 2022-08-03 17:54:59 UTC, end at Wed 2022-08-03 19:39:34 UTC. -- Aug 03 18:54:16.589661 dv-cinder-852024-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 03 18:54:16.596421 dv-cinder-852024-1-iscsi devstack@n-api.service[103582]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 03 18:54:16.598428 dv-cinder-852024-1-iscsi devstack@n-api.service[103582]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 3 18:54:16 2022] *** Aug 03 18:54:16.598428 dv-cinder-852024-1-iscsi devstack@n-api.service[103582]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 03 18:54:16.598428 dv-cinder-852024-1-iscsi devstack@n-api.service[103582]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 03 18:54:16.598428 dv-cinder-852024-1-iscsi devstack@n-api.service[103582]: nodename: dv-cinder-852024-1-iscsi Aug 03 18:54:16.598428 dv-cinder-852024-1-iscsi devstack@n-api.service[103582]: machine: x86_64 Aug 03 18:54:16.598428 dv-cinder-852024-1-iscsi devstack@n-api.service[103582]: clock source: unix Aug 03 18:54:16.598863 dv-cinder-852024-1-iscsi devstack@n-api.service[103582]: pcre jit disabled Aug 03 18:54:16.598863 dv-cinder-852024-1-iscsi devstack@n-api.service[103582]: detected number of CPU cores: 4 Aug 03 18:54:16.598863 dv-cinder-852024-1-iscsi devstack@n-api.service[103582]: current working directory: / Aug 03 18:54:16.598863 dv-cinder-852024-1-iscsi devstack@n-api.service[103582]: detected binary path: /usr/bin/uwsgi-core Aug 03 18:54:16.598863 dv-cinder-852024-1-iscsi devstack@n-api.service[103582]: your processes number limit is 47680 Aug 03 18:54:16.598863 dv-cinder-852024-1-iscsi devstack@n-api.service[103582]: your memory page size is 4096 bytes Aug 03 18:54:16.598863 dv-cinder-852024-1-iscsi devstack@n-api.service[103582]: detected max file descriptor number: 2048 Aug 03 18:54:16.598863 dv-cinder-852024-1-iscsi devstack@n-api.service[103582]: lock engine: pthread robust mutexes Aug 03 18:54:16.598863 dv-cinder-852024-1-iscsi devstack@n-api.service[103582]: thunder lock: enabled Aug 03 18:54:16.598863 dv-cinder-852024-1-iscsi devstack@n-api.service[103582]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 03 18:54:16.598863 dv-cinder-852024-1-iscsi devstack@n-api.service[103582]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 03 18:54:16.639506 dv-cinder-852024-1-iscsi devstack@n-api.service[103582]: Python main interpreter initialized at 0x56133e04c9c0 Aug 03 18:54:16.639506 dv-cinder-852024-1-iscsi devstack@n-api.service[103582]: python threads support enabled Aug 03 18:54:16.639506 dv-cinder-852024-1-iscsi devstack@n-api.service[103582]: your server socket listen backlog is limited to 100 connections Aug 03 18:54:16.639506 dv-cinder-852024-1-iscsi devstack@n-api.service[103582]: your mercy for graceful operations on workers is 90 seconds Aug 03 18:54:16.639910 dv-cinder-852024-1-iscsi devstack@n-api.service[103582]: mapped 403077 bytes (393 KB) for 2 cores Aug 03 18:54:16.639988 dv-cinder-852024-1-iscsi devstack@n-api.service[103582]: *** Operational MODE: preforking *** Aug 03 18:54:16.640219 dv-cinder-852024-1-iscsi devstack@n-api.service[103582]: *** uWSGI is running in multiple interpreter mode *** Aug 03 18:54:16.640219 dv-cinder-852024-1-iscsi devstack@n-api.service[103582]: spawned uWSGI master process (pid: 103582) Aug 03 18:54:16.640419 dv-cinder-852024-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 03 18:54:16.640991 dv-cinder-852024-1-iscsi devstack@n-api.service[103582]: spawned uWSGI worker 1 (pid: 103583, cores: 1) Aug 03 18:54:16.641329 dv-cinder-852024-1-iscsi devstack@n-api.service[103582]: spawned uWSGI worker 2 (pid: 103584, cores: 1) Aug 03 18:54:16.641491 dv-cinder-852024-1-iscsi devstack@n-api.service[103582]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 03 18:54:17.306165 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 03 18:54:17.314168 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 03 18:54:18.393824 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 18:54:18.393824 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: from cryptography.utils import int_from_bytes Aug 03 18:54:18.394462 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 18:54:18.394462 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: from cryptography.utils import int_from_bytes Aug 03 18:54:18.414386 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 18:54:18.414386 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: from cryptography.utils import int_from_bytes Aug 03 18:54:18.414882 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 18:54:18.414882 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: from cryptography.utils import int_from_bytes Aug 03 18:54:20.900798 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 18:54:20.901570 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 18:54:20.901570 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 18:54:20.901738 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 18:54:20.902079 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 18:54:20.902154 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 18:54:20.902220 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 18:54:20.902407 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 18:54:20.902522 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.902775 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 18:54:20.902874 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.903060 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 18:54:20.903165 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.903437 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.903542 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.903769 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.903866 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.904081 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.904169 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.904403 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.904509 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.904724 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.904815 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.905036 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.905134 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.905299 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.905395 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.905615 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.905709 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.905939 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852024-1-iscsi {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.906035 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.906248 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.906339 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.906555 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.906650 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.906867 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.906990 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852024-1-iscsi {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.907222 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.907375 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.907527 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.907672 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.907842 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.907960 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.908145 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.908244 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.908460 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.908652 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.908777 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.909790 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.909894 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.909894 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.910027 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.910120 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.910196 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.910263 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.910329 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.910393 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.910497 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.910643 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.910833 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.910922 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.911186 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.911322 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.911517 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.911642 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.911805 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.911933 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.912115 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.912246 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852024-1-iscsi {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.912442 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.912568 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.912755 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.912893 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.913102 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.913288 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852024-1-iscsi {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.913457 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.913588 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.913774 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.913909 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.914091 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.914225 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.914411 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.914537 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.914733 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.914861 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.915076 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.915205 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.915405 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.915533 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.915725 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.915953 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.916670 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.916813 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.917006 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.917137 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.917313 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.917441 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.917642 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.917785 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.917969 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.918097 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.918278 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.918412 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.918592 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.918730 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.918906 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.919067 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.919287 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.919435 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.919637 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.919770 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.919894 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.920016 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.920138 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.920261 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.920391 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.920514 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.920646 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.920770 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.920892 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.921034 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.921160 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.921334 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.921462 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.921586 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.921769 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.921910 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.922078 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.922204 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.922386 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.922518 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.922693 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.922821 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.923019 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.923148 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.923328 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.923456 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.923633 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.923763 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.923940 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.924067 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.924260 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.924396 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.924570 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.924697 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.924881 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.925007 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.925186 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.925310 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.925506 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.925634 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.925828 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.925961 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.77 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.926138 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.77 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.926273 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.926449 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.926577 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.926789 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.926917 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.77 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.927117 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.77 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.927270 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.927428 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.927566 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.927747 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.927875 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.928067 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.928208 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.928380 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.928506 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.928685 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.928812 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.928992 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.929131 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.929310 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.929443 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.929625 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.929758 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.929936 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.930029 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.930185 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.930281 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.930487 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.930576 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.930795 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.930884 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.931138 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.931242 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.931473 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.931597 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.931785 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.931943 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.932089 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.932193 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.932388 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.932476 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.932695 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.932785 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.933002 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.933089 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.933309 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.933413 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.933614 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.933704 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.933920 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.934009 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.934225 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.934322 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.934532 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.934620 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.934836 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.934930 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.935166 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.935272 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.935484 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.935581 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.935792 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.935881 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.936099 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.936194 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.936408 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.936495 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.936712 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.936810 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.937017 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.937185 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.937329 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.937418 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.937637 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.937743 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.937942 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.938041 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.938265 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.938352 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.938568 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.938654 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.938875 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.939000 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.939218 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.939321 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.939530 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.939630 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.939832 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.939928 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.940153 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.940241 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.940452 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.940538 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.940759 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.940855 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.941077 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.941165 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.941381 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.941468 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.941687 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.941782 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.941993 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.942080 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.942297 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.942410 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.942600 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.942689 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.942905 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.943013 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.943230 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.943317 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.943534 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.943623 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.943835 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.943921 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.944140 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.944226 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.944450 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.944538 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.944754 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.944885 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.945060 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.945156 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.945364 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.945452 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.945681 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.945768 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.945991 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.946086 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.946302 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.946397 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.946626 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:54:20.946714 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.946979 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.947162 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.947412 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.947505 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.947751 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.947840 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.948071 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.948183 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.948392 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.948488 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.948708 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.948797 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.949035 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.949124 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.949348 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.949444 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.949660 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.949749 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.949973 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.950062 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.950291 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.950390 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.950610 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.950696 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.950931 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.951047 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.951267 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.951364 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.951585 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.951674 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.951905 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.952001 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.952216 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.952305 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.952535 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.952634 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.952860 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.952949 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.953180 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.953267 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.953488 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.953574 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.953828 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.953923 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.954157 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.954246 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.954473 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.954573 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.954801 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.954909 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.955149 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.955250 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.955462 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.955560 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.955773 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.955865 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.956083 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.956173 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.956404 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.956500 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.956733 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.956820 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.957044 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.957129 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.957363 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.957460 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.957678 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.957767 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.957991 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.958081 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.958306 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.958395 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.958618 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.958712 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.958931 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.959078 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.959272 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.959362 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.959593 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.959688 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.959912 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.960005 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.960222 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.960311 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.960540 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.960627 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.960854 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.960950 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.961165 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.961255 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.961478 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.961565 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.961784 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.961881 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.962091 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.962180 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.962395 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.962490 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.963313 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.963429 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.963625 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.963713 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.963949 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.964037 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.964279 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.964376 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.964588 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.964675 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.964922 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.965011 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.965229 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.965331 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.965541 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.965629 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.965851 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.965939 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.966163 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.966253 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.966470 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.966558 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.966783 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.966878 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.967119 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.967210 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.967427 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.967517 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.967744 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.967833 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.968053 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.968141 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.968362 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.968449 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.968683 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.968771 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.968988 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.969078 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.969293 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.969388 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.969607 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.969703 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.969917 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.970014 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.970225 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.970315 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.970539 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.970637 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.970853 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.970940 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.971197 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.971331 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.971513 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.971615 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.971827 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.971914 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.972159 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.972247 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.972479 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.972592 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.972784 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.972861 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.973111 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.973208 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.973439 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.973528 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.973746 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.973928 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.974078 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.974244 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.974411 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.974556 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.974734 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.974865 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.975068 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.975197 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.975388 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.975506 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.975704 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.975819 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.976014 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.976129 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.976326 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.976438 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.976643 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.976750 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.976952 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.977050 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.977263 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.977359 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.977574 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.977668 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.977883 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.977980 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.978191 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.978326 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.979118 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.979439 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.979537 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.979754 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.979845 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.980069 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.980158 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.980380 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.980476 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.980732 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.980822 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.981048 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.981138 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.981399 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.981501 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.981725 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.981812 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.982045 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.982143 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.982365 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.982462 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.982680 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.982782 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.983019 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.983112 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.983339 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.983438 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.983656 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.983745 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.983974 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.984060 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.984288 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.984385 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.984613 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.984700 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.984932 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.985020 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.985260 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.985358 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.985579 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.985675 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.985916 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.986004 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.986233 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.986328 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.986556 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.986653 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.986869 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.986984 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.987219 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.987311 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.987555 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.987643 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.987883 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.987970 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.988200 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.988297 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.988517 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.988605 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.988831 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.988920 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.989151 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.989248 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.989465 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.989552 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.989783 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.989946 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.990101 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.990189 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.990412 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.990497 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.990733 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.990833 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.991070 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.991173 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.991398 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.991494 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.991710 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.991806 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.992033 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.992120 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.992341 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.992437 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.992657 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.992754 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.992966 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.993052 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.993288 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.993375 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.993608 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.993703 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.993961 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.994101 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.994320 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.994416 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.994644 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.994734 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.995000 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.995091 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.995290 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.995378 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.995599 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.995689 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.995909 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.996005 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.996220 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.996306 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.996535 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.996622 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.996846 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.996934 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.997157 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.997251 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.997467 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.997556 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.997781 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.997867 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.998089 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.998184 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.998398 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.998485 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.998705 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.998805 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.999038 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.999141 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.999353 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.999441 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.999664 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.999750 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:20.999987 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.000084 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.000305 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.000391 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.000608 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.000698 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.000916 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.001014 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.001239 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.001327 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.001549 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.001636 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.001852 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.001945 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.002160 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.002248 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.002466 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.002554 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.002778 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.002867 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.003136 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.003227 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.003448 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.003535 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.003766 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.003857 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.004090 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.004180 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.004405 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.004514 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.004722 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.004818 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.005036 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.005122 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.005344 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.005494 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.005661 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.005750 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.005975 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.006069 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.006287 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.006385 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.006599 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.006695 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.006910 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.007101 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.007243 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.007343 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.007557 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.007645 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.007872 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.007966 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.008179 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.008280 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.008491 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.008580 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.008806 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.008895 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.009114 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.009204 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.009424 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.009549 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.009760 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.009863 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.010080 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.010331 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.010422 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.010668 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.010986 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.011093 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.011317 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.011408 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.011638 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.011725 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.011959 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.012056 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.012286 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.012646 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.012877 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.012966 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.013214 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.013311 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.013524 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.013629 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.013836 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.013927 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.014146 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.014244 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.014455 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.014545 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.014768 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.014860 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.015104 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.015194 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.015414 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.015501 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.015720 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.015819 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.016030 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.016131 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.016334 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.016435 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.016641 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.016732 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.016948 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.017035 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.017251 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.017348 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.017557 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.017645 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.017862 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.017950 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.018173 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.018270 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.018479 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.018570 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.018795 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.018884 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.019129 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.019233 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.019434 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.019525 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.019743 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.019834 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.020049 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.020138 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.020353 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.020450 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.020664 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.020761 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.021018 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.021148 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.021326 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.021424 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.021669 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.021758 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.021975 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.022063 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.022282 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.022370 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.022610 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.022699 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.022918 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.023074 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.023247 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.023336 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.023553 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.023659 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.023861 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.023987 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.024169 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.024264 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.024474 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.024571 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.024782 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.024869 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.025090 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.025771 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.025934 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.026032 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.026247 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.026440 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.026554 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.026764 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.026860 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.027110 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.027202 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.027427 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.027517 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.027746 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.027844 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.028059 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.028148 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.028366 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.028460 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.028681 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.028786 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.028989 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.029077 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.029297 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.029387 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.029608 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.029704 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.029915 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.030010 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.030221 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.030309 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.030527 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.030623 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.030833 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.030929 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.031165 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.031255 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.031479 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.031568 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.031788 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.031877 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.032093 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.032180 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.032406 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.032502 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.032721 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.032817 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.033026 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.033113 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.033335 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.033425 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.033647 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.033736 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.033955 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.034085 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.034259 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.034349 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.034569 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.034657 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.034877 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.035012 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.035216 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.035307 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.035522 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.035618 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.035834 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.035931 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.036140 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.036228 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.036449 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.036544 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.036811 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.036930 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.037060 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.037148 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.037362 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.037448 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.037668 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.037768 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.037971 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.038067 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.038276 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.038363 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.038579 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.038667 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.038884 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.038993 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.039220 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.039309 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.039523 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.039612 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.039832 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.039923 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.040136 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.040233 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.040442 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.040531 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.040778 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.041492 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.041624 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.041951 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.042054 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.042267 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.042357 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.042590 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.042713 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.042914 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.043056 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.043254 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.043352 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.043569 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.043657 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.043888 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.043978 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.044194 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.044290 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.044511 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.044601 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.044825 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.044920 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.045141 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.045229 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.045447 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.045535 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.045755 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.045852 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.046079 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.046167 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.046392 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.046481 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.046706 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.046803 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.047051 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.047144 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.047374 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.047476 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.047698 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.047787 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.048003 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.048094 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.048314 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.048411 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.048626 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.048715 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.048936 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.049024 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.049245 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.049343 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.049554 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.049642 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.049867 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.049955 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.050181 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.050278 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.050495 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.050584 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.050809 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.050901 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.051146 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.051252 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.051453 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.051551 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.051764 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.051860 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.052076 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.052165 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.052380 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.052476 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.052695 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.052783 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.053003 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.053092 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.053310 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.053400 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.053619 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.053708 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.053924 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.054014 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.054236 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.054323 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.054541 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.054637 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.054858 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.054973 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.055197 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.055286 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.055591 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.055691 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.055899 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.055999 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.056211 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.056299 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.056612 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.056717 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.056969 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.057071 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.057288 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.057377 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.057613 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.057711 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.057936 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.058024 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.058247 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.058335 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.058630 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.058734 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.058973 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.059073 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.059272 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.059373 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.059580 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.059670 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.059892 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.059980 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.060210 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.060297 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.060513 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.060602 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.060819 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.060907 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.061123 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.061212 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.061442 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.061531 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.061746 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.061834 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.062072 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.062170 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.062382 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.062490 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.062710 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.062799 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.063123 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.063231 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.063469 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.063558 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.063783 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.063873 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.064137 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.064233 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.064463 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.064551 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.064788 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.064878 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.065117 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.065214 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.065427 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.065516 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.065744 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.065858 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.066056 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.066156 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.066373 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.066470 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.066690 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.066787 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.067028 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.067119 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.067348 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.067438 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.067654 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.067751 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.067982 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.068081 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.068289 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.068386 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.068605 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.068702 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.068930 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.069020 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.069245 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.069335 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.069576 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.069678 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.069959 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.070046 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.070281 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.070378 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.070607 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.070696 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.070913 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.071084 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.071242 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.071332 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.071552 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.071644 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.071857 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.071956 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.072190 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.072322 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.072513 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.072674 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.072817 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.072998 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.073129 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.073331 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.073430 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.073646 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.073742 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.073968 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.074058 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.074288 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.074378 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.074604 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.074707 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.074916 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.075084 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.075256 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.075359 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.075571 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.075669 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.075889 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.075977 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.076208 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.076301 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.076515 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.076615 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.076837 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.076926 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.077145 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.077234 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.077452 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.077550 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.077758 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.077854 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.078063 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.078152 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.078380 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.078477 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.078693 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.078783 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.079028 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.079132 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.079361 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.079450 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.079680 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.079768 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.079997 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.080092 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.080331 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.080420 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.080657 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.080745 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.080971 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.081068 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.081288 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.081375 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.081615 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.081704 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.081922 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.082024 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.082227 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.082317 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.082538 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.082626 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.082843 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.082963 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.083174 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.083268 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.083478 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.083621 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.083788 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.083886 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.084089 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.084177 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.084395 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.084483 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.084700 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.084793 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.085006 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.085094 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.085310 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.085399 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.085616 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.085705 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.085950 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.086038 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.086264 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.086391 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.086593 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.086695 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.086896 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.087046 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.087235 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.087336 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.087547 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.088189 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.088570 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.088670 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.088927 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.089027 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.089240 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.089331 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.089577 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.089667 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.089893 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.089991 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.090216 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.090304 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.090537 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.090626 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.090857 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.091003 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.091203 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.091295 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.091524 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.091613 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.091834 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.091931 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.092155 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.092253 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.092471 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.092559 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.092786 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.092953 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.093111 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.093314 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.093433 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.093650 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.093750 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.093971 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.094271 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.094360 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.094593 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.094732 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.094911 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.095026 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.095255 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.095345 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.095574 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.095662 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.095888 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.095978 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.096203 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.096332 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.096546 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.096651 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.096835 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.096924 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.097155 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.097244 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.097474 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.097572 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.097808 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.097905 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.098130 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.098219 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.098450 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.098548 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.098768 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.098864 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.099112 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.099255 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.099439 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.099531 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.099764 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.099863 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.100071 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.100159 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.100391 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.100483 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.100709 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.100798 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.101025 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.101123 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.101342 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.101431 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.101656 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.101745 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.101974 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.102081 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.102291 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.102388 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.102603 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.102691 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.102915 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.103037 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.103266 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.103401 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.104121 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.104225 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.104440 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.104589 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.105178 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.105178 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.105337 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.105470 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.105618 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.105709 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.105940 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.106030 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.106259 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.106406 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.106582 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.106673 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.106977 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.107142 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.107466 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.107566 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.107808 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.107924 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.108143 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.108236 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.108475 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.108631 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.108796 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.108892 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.109121 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.109217 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.109447 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.109546 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.109756 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.109845 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.110073 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.110162 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.110383 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.110473 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.110693 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.110780 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.111028 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.111120 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.111341 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.111437 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.111658 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.111747 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.111967 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.112055 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.112275 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.112373 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.112587 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.112675 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.112904 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.113120 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.113441 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.113532 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.113792 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.113880 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.114100 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.114206 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.114424 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.114511 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.114746 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.114881 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.115075 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.115182 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.115391 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.115480 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.115699 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.115794 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.116008 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.116105 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.116322 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.116410 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.116631 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.116718 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.116938 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.117034 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.117244 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.117342 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.117551 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.117638 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.117860 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.117955 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.118167 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.118256 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.118473 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.118560 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.118775 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.118882 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.119137 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.119332 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.119473 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.119812 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.119926 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.120120 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.120216 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.120431 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.120521 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.120748 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.120850 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.121057 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.121146 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.121363 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.121465 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.121673 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.121770 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.121980 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.122069 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.122296 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.122385 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.122603 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.122700 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.122912 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.123019 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.123245 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.123335 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.123563 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.123653 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.123870 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.123958 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.124181 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.124269 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.124489 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.124587 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.124816 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.124913 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.125125 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.125226 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.125477 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.125565 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.125798 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.125885 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.126109 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.126211 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.126436 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.126523 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.126750 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.126844 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.127095 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.127207 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.127448 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.127536 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.127766 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.127853 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.128303 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.128404 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.128637 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.128724 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.128963 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.129063 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.129297 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.129386 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.129633 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.129720 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.129947 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.130034 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.130256 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.130351 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.130561 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.130651 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.130888 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.130992 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.131226 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.131326 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.131540 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.131636 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.131852 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.131939 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.132164 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.132263 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.132479 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.132568 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.132787 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.132884 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.133100 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.133189 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.133411 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.133499 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.133720 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.133817 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.134033 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.134123 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.134346 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.134435 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.134685 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.134793 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.135023 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.135158 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.135341 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.135431 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.135662 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.135805 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.136005 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.136094 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.136330 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.136417 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.136650 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.136744 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.136971 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.137066 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.137290 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.137639 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.137866 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.137956 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.138179 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.138274 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.138488 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.138583 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.138799 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.138895 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.139140 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.139228 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.139475 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.139578 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.139790 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.139879 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.140099 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.140186 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.140519 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.140616 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.140837 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.140933 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.141158 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.141247 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.141483 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.141585 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.141797 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.141885 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.142120 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.142207 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.142448 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.142537 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.142760 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.142847 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.143109 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.143201 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.143423 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.143512 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.143755 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.143844 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.144097 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.144195 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.144425 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.144521 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.144751 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.144840 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.145057 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.145158 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.145367 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.145455 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.145671 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.145758 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.145985 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.146138 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.146304 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.146394 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.146616 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.146759 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.146921 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.147085 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.147248 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.147347 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.147559 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.147649 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.147864 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.147953 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.148178 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.148285 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.148473 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.148565 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.148775 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.148864 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.149086 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.149173 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.149387 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.149476 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.149692 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.149789 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.150001 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.150088 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.150986 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.151089 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.151239 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.151352 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.151530 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.151619 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.151846 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.152015 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.152152 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.152249 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.152461 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.152549 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.152765 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.152861 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.153073 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.153161 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.153377 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.153472 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.153712 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.153815 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.154048 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.154136 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.154365 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.154455 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.154689 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.154801 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.155029 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.155122 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.155355 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.155452 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.155669 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.155758 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.155992 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.156082 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.156317 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.156406 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.156633 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.156722 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.156946 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.157038 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.157276 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.157364 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.157590 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.157680 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.157903 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.157992 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.158219 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.158317 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.158530 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.158618 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.158843 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.158939 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.159180 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.159288 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.159510 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.159608 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.159840 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.159936 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.160149 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.160248 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.160478 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.160566 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.160796 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.160885 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.161120 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.161212 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.161437 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.161542 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.161752 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.161896 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.162083 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.162174 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.162398 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.162487 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.162714 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.162809 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.163057 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.163152 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.163381 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.163470 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.163702 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.163804 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.164025 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.164113 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.164338 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.164427 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.164653 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.164751 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.164971 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.165060 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.165289 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.165386 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.165619 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.165720 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.166505 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.166652 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.166870 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.167029 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.167225 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.167328 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.167556 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.167647 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.167903 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.168001 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.168219 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.168310 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.168565 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.168654 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.168894 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.168983 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.169210 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.169300 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.169527 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.169623 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.169831 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.169918 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:54:21.170075 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 18:54:21.170166 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 18:54:21.325360 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO dbcounter [None req-818e4b99-886c-40f2-bed8-8d154275b022 None None] Registered counter for database nova_api Aug 03 18:54:21.325571 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO dbcounter [None req-5037a7f5-9c43-4a72-bbeb-c5a3b06fc242 None None] Registered counter for database nova_api Aug 03 18:54:21.346136 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG oslo_db.sqlalchemy.engines [None req-5037a7f5-9c43-4a72-bbeb-c5a3b06fc242 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103584) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 18:54:21.349617 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG oslo_db.sqlalchemy.engines [None req-818e4b99-886c-40f2-bed8-8d154275b022 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 18:54:21.352754 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG dbcounter [-] [103584] Writer thread running {{(pid=103584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 18:54:21.356798 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG dbcounter [-] [103583] Writer thread running {{(pid=103583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 18:54:21.409799 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.context [None req-5037a7f5-9c43-4a72-bbeb-c5a3b06fc242 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),68a582b5-bf89-4c4b-b661-ad002d2788a1(cell1) {{(pid=103584) load_cells /opt/stack/nova/nova/context.py:464}} Aug 03 18:54:21.412152 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.context [None req-818e4b99-886c-40f2-bed8-8d154275b022 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),68a582b5-bf89-4c4b-b661-ad002d2788a1(cell1) {{(pid=103583) load_cells /opt/stack/nova/nova/context.py:464}} Aug 03 18:54:21.413691 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG oslo_concurrency.lockutils [None req-5037a7f5-9c43-4a72-bbeb-c5a3b06fc242 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:21.415333 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG oslo_concurrency.lockutils [None req-5037a7f5-9c43-4a72-bbeb-c5a3b06fc242 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:21.416628 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG oslo_concurrency.lockutils [None req-818e4b99-886c-40f2-bed8-8d154275b022 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:21.416754 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG oslo_concurrency.lockutils [None req-5037a7f5-9c43-4a72-bbeb-c5a3b06fc242 None None] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:21.418329 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG oslo_concurrency.lockutils [None req-818e4b99-886c-40f2-bed8-8d154275b022 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:21.418622 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG oslo_concurrency.lockutils [None req-5037a7f5-9c43-4a72-bbeb-c5a3b06fc242 None None] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:21.419229 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG oslo_concurrency.lockutils [None req-818e4b99-886c-40f2-bed8-8d154275b022 None None] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:21.420655 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO dbcounter [None req-5037a7f5-9c43-4a72-bbeb-c5a3b06fc242 None None] Registered counter for database nova_cell0 Aug 03 18:54:21.421186 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG oslo_concurrency.lockutils [None req-818e4b99-886c-40f2-bed8-8d154275b022 None None] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:21.423184 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO dbcounter [None req-818e4b99-886c-40f2-bed8-8d154275b022 None None] Registered counter for database nova_cell0 Aug 03 18:54:21.426077 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO dbcounter [None req-5037a7f5-9c43-4a72-bbeb-c5a3b06fc242 None None] Registered counter for database nova_cell1 Aug 03 18:54:21.428764 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO dbcounter [None req-818e4b99-886c-40f2-bed8-8d154275b022 None None] Registered counter for database nova_cell1 Aug 03 18:54:21.434930 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG oslo_db.sqlalchemy.engines [None req-5037a7f5-9c43-4a72-bbeb-c5a3b06fc242 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103584) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 18:54:21.438595 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG oslo_db.sqlalchemy.engines [None req-5037a7f5-9c43-4a72-bbeb-c5a3b06fc242 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103584) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 18:54:21.438717 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG oslo_db.sqlalchemy.engines [None req-818e4b99-886c-40f2-bed8-8d154275b022 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 18:54:21.440426 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG oslo_db.sqlalchemy.engines [None req-818e4b99-886c-40f2-bed8-8d154275b022 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 18:54:21.445441 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG dbcounter [-] [103584] Writer thread running {{(pid=103584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 18:54:21.446543 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG dbcounter [-] [103583] Writer thread running {{(pid=103583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 18:54:21.447565 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG dbcounter [-] [103584] Writer thread running {{(pid=103584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 18:54:21.448084 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG dbcounter [-] [103583] Writer thread running {{(pid=103583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 18:54:21.595418 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO dbcounter [None req-818e4b99-886c-40f2-bed8-8d154275b022 None None] Registered counter for database nova_cell0 Aug 03 18:54:21.597232 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO dbcounter [None req-5037a7f5-9c43-4a72-bbeb-c5a3b06fc242 None None] Registered counter for database nova_cell0 Aug 03 18:54:21.602230 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG oslo_db.sqlalchemy.engines [None req-818e4b99-886c-40f2-bed8-8d154275b022 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 18:54:21.606035 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG oslo_db.sqlalchemy.engines [None req-5037a7f5-9c43-4a72-bbeb-c5a3b06fc242 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103584) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 18:54:21.607100 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG dbcounter [-] [103583] Writer thread running {{(pid=103583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 18:54:21.610720 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG dbcounter [-] [103584] Writer thread running {{(pid=103584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 18:54:22.008201 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: WARNING keystonemiddleware.auth_token [None req-818e4b99-886c-40f2-bed8-8d154275b022 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 18:54:22.016414 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: WARNING keystonemiddleware.auth_token [None req-818e4b99-886c-40f2-bed8-8d154275b022 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 18:54:22.030864 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: WARNING keystonemiddleware.auth_token [None req-5037a7f5-9c43-4a72-bbeb-c5a3b06fc242 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 18:54:22.038128 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: WARNING keystonemiddleware.auth_token [None req-5037a7f5-9c43-4a72-bbeb-c5a3b06fc242 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 18:54:22.360435 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: WARNING keystonemiddleware.auth_token [None req-818e4b99-886c-40f2-bed8-8d154275b022 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 18:54:22.366389 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: WARNING keystonemiddleware.auth_token [None req-818e4b99-886c-40f2-bed8-8d154275b022 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 18:54:22.372437 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56133e04c9c0 pid: 103583 (default app) Aug 03 18:54:22.374488 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-818e4b99-886c-40f2-bed8-8d154275b022 None None] Calling method '>' {{(pid=103583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:22.375685 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO nova.api.openstack.requestlog [None req-818e4b99-886c-40f2-bed8-8d154275b022 None None] 10.222.0.77 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001720 Aug 03 18:54:22.376087 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: [pid: 103583|app: 0|req: 1/1] 10.222.0.77 () {50 vars in 788 bytes} [Wed Aug 3 18:54:22 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:54:22.379392 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: WARNING keystonemiddleware.auth_token [None req-5037a7f5-9c43-4a72-bbeb-c5a3b06fc242 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 18:54:22.386023 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: WARNING keystonemiddleware.auth_token [None req-5037a7f5-9c43-4a72-bbeb-c5a3b06fc242 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 18:54:22.391585 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56133e04c9c0 pid: 103584 (default app) Aug 03 18:55:42.522850 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-818e4b99-886c-40f2-bed8-8d154275b022 None None] Calling method '>' {{(pid=103583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:42.524011 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO nova.api.openstack.requestlog [None req-818e4b99-886c-40f2-bed8-8d154275b022 None None] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Aug 03 18:55:42.524407 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: [pid: 103583|app: 0|req: 2/2] 10.222.0.77 () {54 vars in 930 bytes} [Wed Aug 3 18:55:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:55:42.536858 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG dbcounter [-] [103584] Writing DB stats nova_api:SELECT=3 {{(pid=103584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:55:42.545318 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG dbcounter [-] [103584] Writing DB stats nova_cell0:SELECT=3 {{(pid=103584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:55:42.545318 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG dbcounter [-] [103584] Writing DB stats nova_cell1:SELECT=3 {{(pid=103584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:55:42.545318 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG dbcounter [-] [103584] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:55:43.404182 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-60d1d849-0e66-46d1-a347-8bfde25d3d6e admin admin] Calling method '>' {{(pid=103584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:43.436642 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO nova.api.openstack.requestlog [None req-60d1d849-0e66-46d1-a347-8bfde25d3d6e admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.904877 Aug 03 18:55:43.437569 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: [pid: 103584|app: 0|req: 1/3] 10.222.0.77 () {60 vars in 1291 bytes} [Wed Aug 3 18:55:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:45.673626 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-818e4b99-886c-40f2-bed8-8d154275b022 None None] Calling method '>' {{(pid=103583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:45.674650 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO nova.api.openstack.requestlog [None req-818e4b99-886c-40f2-bed8-8d154275b022 None None] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Aug 03 18:55:45.679072 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: [pid: 103583|app: 0|req: 3/4] 10.222.0.77 () {54 vars in 930 bytes} [Wed Aug 3 18:55:45 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:55:46.144646 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-9ce13c2c-5f6e-48fa-980c-b6dbe9411b62 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "cirros256", "rxtx_factor": 1.0, "id": "c1", "disk": 1, "os-flavor-access:is_public": true}} {{(pid=103584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:55:46.165431 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 18:55:46.165431 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: warnings.warn(msg) Aug 03 18:55:46.233843 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO nova.api.openstack.requestlog [None req-9ce13c2c-5f6e-48fa-980c-b6dbe9411b62 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.552744 Aug 03 18:55:46.234550 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: [pid: 103584|app: 0|req: 2/5] 10.222.0.77 () {64 vars in 1282 bytes} [Wed Aug 3 18:55:45 2022] POST /compute/v2.1/flavors => generated 407 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 18:55:46.455715 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-091162bf-e032-4a6e-ae06-7f4bd9670b69 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:55:46.460095 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 18:55:46.460095 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: warnings.warn(msg) Aug 03 18:55:46.462786 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG dbcounter [-] [103583] Writing DB stats nova_api:SELECT=3 {{(pid=103583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:55:46.464828 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG dbcounter [-] [103583] Writing DB stats nova_cell0:SELECT=3 {{(pid=103583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:55:46.465232 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG dbcounter [-] [103583] Writing DB stats nova_cell1:SELECT=3 {{(pid=103583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:55:46.465857 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG dbcounter [-] [103583] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:55:46.607180 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO nova.api.openstack.requestlog [None req-091162bf-e032-4a6e-ae06-7f4bd9670b69 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.364182 Aug 03 18:55:46.607787 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: [pid: 103583|app: 0|req: 4/6] 10.222.0.77 () {64 vars in 1335 bytes} [Wed Aug 3 18:55:46 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:48.848912 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-9ce13c2c-5f6e-48fa-980c-b6dbe9411b62 admin admin] Calling method '>' {{(pid=103584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:48.850140 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO nova.api.openstack.requestlog [None req-9ce13c2c-5f6e-48fa-980c-b6dbe9411b62 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001763 Aug 03 18:55:48.850626 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: [pid: 103584|app: 0|req: 3/7] 10.222.0.77 () {54 vars in 930 bytes} [Wed Aug 3 18:55:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:55:49.523492 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-a8002a00-8e1f-44fa-939b-440a718b6eb6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "disk": 5, "swap": 0, "name": "ds512M", "id": "d1", "vcpus": 1}} {{(pid=103583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:55:49.543542 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 18:55:49.543542 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: warnings.warn(msg) Aug 03 18:55:49.676914 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO nova.api.openstack.requestlog [None req-a8002a00-8e1f-44fa-939b-440a718b6eb6 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.818718 Aug 03 18:55:49.677583 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: [pid: 103583|app: 0|req: 5/8] 10.222.0.77 () {64 vars in 1282 bytes} [Wed Aug 3 18:55:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 18:55:49.689368 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-9a95a7ce-9ac5-4dd6-8357-968d1a8dada6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:55:49.692260 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 18:55:49.692260 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: warnings.warn(msg) Aug 03 18:55:49.811153 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO nova.api.openstack.requestlog [None req-9a95a7ce-9ac5-4dd6-8357-968d1a8dada6 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.125384 Aug 03 18:55:49.823081 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: [pid: 103584|app: 0|req: 4/9] 10.222.0.77 () {64 vars in 1335 bytes} [Wed Aug 3 18:55:49 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:52.083977 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-a8002a00-8e1f-44fa-939b-440a718b6eb6 admin admin] Calling method '>' {{(pid=103583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:52.084908 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO nova.api.openstack.requestlog [None req-a8002a00-8e1f-44fa-939b-440a718b6eb6 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Aug 03 18:55:52.085301 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: [pid: 103583|app: 0|req: 6/10] 10.222.0.77 () {54 vars in 930 bytes} [Wed Aug 3 18:55:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:55:52.493664 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-66687da3-1b8e-4d97-8433-317d7b3ccd40 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds1G", "swap": 0, "id": "d2", "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 1024}} {{(pid=103584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:55:52.589049 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO nova.api.openstack.requestlog [None req-66687da3-1b8e-4d97-8433-317d7b3ccd40 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.497851 Aug 03 18:55:52.589603 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: [pid: 103584|app: 0|req: 5/11] 10.222.0.77 () {64 vars in 1282 bytes} [Wed Aug 3 18:55:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 18:55:52.601714 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-d6c09509-897b-43b2-b880-9f2340e27e82 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:55:52.696223 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO nova.api.openstack.requestlog [None req-d6c09509-897b-43b2-b880-9f2340e27e82 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098005 Aug 03 18:55:52.696739 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: [pid: 103583|app: 0|req: 7/12] 10.222.0.77 () {64 vars in 1335 bytes} [Wed Aug 3 18:55:52 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:54.937018 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-66687da3-1b8e-4d97-8433-317d7b3ccd40 admin admin] Calling method '>' {{(pid=103584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:54.938037 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO nova.api.openstack.requestlog [None req-66687da3-1b8e-4d97-8433-317d7b3ccd40 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 03 18:55:54.938436 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: [pid: 103584|app: 0|req: 6/13] 10.222.0.77 () {54 vars in 930 bytes} [Wed Aug 3 18:55:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:55:55.433357 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-ab1a76ab-e764-482b-b206-fef9f25ef9d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "d3", "name": "ds2G", "rxtx_factor": 1.0, "vcpus": 2, "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:55:55.505142 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO nova.api.openstack.requestlog [None req-ab1a76ab-e764-482b-b206-fef9f25ef9d3 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.560812 Aug 03 18:55:55.505871 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: [pid: 103583|app: 0|req: 8/14] 10.222.0.77 () {64 vars in 1282 bytes} [Wed Aug 3 18:55:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 18:55:55.519463 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-472dff03-d4ff-4c0e-980a-20aaea5d1c75 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:55:55.595474 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO nova.api.openstack.requestlog [None req-472dff03-d4ff-4c0e-980a-20aaea5d1c75 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079712 Aug 03 18:55:55.596083 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: [pid: 103584|app: 0|req: 7/15] 10.222.0.77 () {64 vars in 1335 bytes} [Wed Aug 3 18:55:55 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:55:57.833916 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-ab1a76ab-e764-482b-b206-fef9f25ef9d3 admin admin] Calling method '>' {{(pid=103583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:57.834918 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO nova.api.openstack.requestlog [None req-ab1a76ab-e764-482b-b206-fef9f25ef9d3 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Aug 03 18:55:57.835782 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: [pid: 103583|app: 0|req: 9/16] 10.222.0.77 () {54 vars in 930 bytes} [Wed Aug 3 18:55:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:55:58.274067 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-7992cb05-db96-4974-bbb2-22bac5e51210 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "name": "ds4G", "vcpus": 4, "swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "disk": 20}} {{(pid=103584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:55:58.396699 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO nova.api.openstack.requestlog [None req-7992cb05-db96-4974-bbb2-22bac5e51210 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.553777 Aug 03 18:55:58.404690 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: [pid: 103584|app: 0|req: 8/17] 10.222.0.77 () {64 vars in 1282 bytes} [Wed Aug 3 18:55:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 18:55:58.417891 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-304f0669-dbef-42ae-b87b-d171c271afc7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:55:58.536273 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO nova.api.openstack.requestlog [None req-304f0669-dbef-42ae-b87b-d171c271afc7 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.128818 Aug 03 18:55:58.537006 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: [pid: 103583|app: 0|req: 10/18] 10.222.0.77 () {64 vars in 1335 bytes} [Wed Aug 3 18:55:58 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:56:00.789410 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-7992cb05-db96-4974-bbb2-22bac5e51210 admin admin] Calling method '>' {{(pid=103584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:00.790533 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO nova.api.openstack.requestlog [None req-7992cb05-db96-4974-bbb2-22bac5e51210 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001557 Aug 03 18:56:00.791048 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: [pid: 103584|app: 0|req: 9/19] 10.222.0.77 () {54 vars in 930 bytes} [Wed Aug 3 18:56:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:56:01.240439 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-7a8a7888-6c81-4109-8a12-c27ed7afcd6c admin admin] Calling method '>' {{(pid=103583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:01.267256 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO nova.api.openstack.requestlog [None req-7a8a7888-6c81-4109-8a12-c27ed7afcd6c admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.470315 Aug 03 18:56:01.267803 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: [pid: 103583|app: 0|req: 11/20] 10.222.0.77 () {60 vars in 1291 bytes} [Wed Aug 3 18:56:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:56:03.476478 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-7992cb05-db96-4974-bbb2-22bac5e51210 admin admin] Calling method '>' {{(pid=103584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:03.477407 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO nova.api.openstack.requestlog [None req-7992cb05-db96-4974-bbb2-22bac5e51210 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Aug 03 18:56:03.477803 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: [pid: 103584|app: 0|req: 10/21] 10.222.0.77 () {54 vars in 930 bytes} [Wed Aug 3 18:56:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:56:03.899932 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-0a9aca22-b9f1-416f-b584-ebceb42b6aac admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "name": "m1.tiny", "ram": 512, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "id": "1"}} {{(pid=103583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:56:03.965152 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO nova.api.openstack.requestlog [None req-0a9aca22-b9f1-416f-b584-ebceb42b6aac admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.480684 Aug 03 18:56:03.965900 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: [pid: 103583|app: 0|req: 12/22] 10.222.0.77 () {64 vars in 1282 bytes} [Wed Aug 3 18:56:03 2022] POST /compute/v2.1/flavors => generated 402 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 18:56:03.980008 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-7bfffec1-68f1-4e6e-ad79-1b345f712e37 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:56:04.058874 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO nova.api.openstack.requestlog [None req-7bfffec1-68f1-4e6e-ad79-1b345f712e37 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083369 Aug 03 18:56:04.059666 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: [pid: 103584|app: 0|req: 11/23] 10.222.0.77 () {64 vars in 1332 bytes} [Wed Aug 3 18:56:03 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:56:06.300563 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-0a9aca22-b9f1-416f-b584-ebceb42b6aac admin admin] Calling method '>' {{(pid=103583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:06.301596 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO nova.api.openstack.requestlog [None req-0a9aca22-b9f1-416f-b584-ebceb42b6aac admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 03 18:56:06.302020 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: [pid: 103583|app: 0|req: 13/24] 10.222.0.77 () {54 vars in 930 bytes} [Wed Aug 3 18:56:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:56:06.714597 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-7de9a6f1-eb26-4798-85c9-9e9e078fa33c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "2", "vcpus": 1, "name": "m1.small", "swap": 0, "rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true}} {{(pid=103584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:56:06.789616 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO nova.api.openstack.requestlog [None req-7de9a6f1-eb26-4798-85c9-9e9e078fa33c admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.478646 Aug 03 18:56:06.790174 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: [pid: 103584|app: 0|req: 12/25] 10.222.0.77 () {64 vars in 1282 bytes} [Wed Aug 3 18:56:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 18:56:06.803170 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-cff6686f-167e-4482-a539-50d88a9d120a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:56:06.896854 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO nova.api.openstack.requestlog [None req-cff6686f-167e-4482-a539-50d88a9d120a admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097417 Aug 03 18:56:06.897431 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: [pid: 103583|app: 0|req: 14/26] 10.222.0.77 () {64 vars in 1332 bytes} [Wed Aug 3 18:56:06 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:56:09.176990 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-7de9a6f1-eb26-4798-85c9-9e9e078fa33c admin admin] Calling method '>' {{(pid=103584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:09.178554 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO nova.api.openstack.requestlog [None req-7de9a6f1-eb26-4798-85c9-9e9e078fa33c admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002218 Aug 03 18:56:09.178973 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: [pid: 103584|app: 0|req: 13/27] 10.222.0.77 () {54 vars in 930 bytes} [Wed Aug 3 18:56:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:56:09.570916 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-c0b2af83-7a6d-4350-b9d0-9a92991c85de admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "os-flavor-access:is_public": true, "name": "m1.medium", "disk": 40, "vcpus": 2, "rxtx_factor": 1.0, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:56:09.660708 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO nova.api.openstack.requestlog [None req-c0b2af83-7a6d-4350-b9d0-9a92991c85de admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.473703 Aug 03 18:56:09.661259 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: [pid: 103583|app: 0|req: 15/28] 10.222.0.77 () {64 vars in 1282 bytes} [Wed Aug 3 18:56:09 2022] POST /compute/v2.1/flavors => generated 406 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 18:56:09.674917 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-27a0ff7d-7f75-473a-bacc-d47afafa2451 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:56:09.771521 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO nova.api.openstack.requestlog [None req-27a0ff7d-7f75-473a-bacc-d47afafa2451 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100101 Aug 03 18:56:09.772155 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: [pid: 103584|app: 0|req: 14/29] 10.222.0.77 () {64 vars in 1332 bytes} [Wed Aug 3 18:56:09 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:56:11.995828 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-c0b2af83-7a6d-4350-b9d0-9a92991c85de admin admin] Calling method '>' {{(pid=103583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:11.997517 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO nova.api.openstack.requestlog [None req-c0b2af83-7a6d-4350-b9d0-9a92991c85de admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002169 Aug 03 18:56:11.998196 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: [pid: 103583|app: 0|req: 16/30] 10.222.0.77 () {54 vars in 930 bytes} [Wed Aug 3 18:56:11 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:56:12.457923 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-9f9d50d9-5d94-4ddf-8f08-364fe17a504c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "4", "name": "m1.large", "ram": 8192, "vcpus": 4, "rxtx_factor": 1.0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:56:12.533976 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO nova.api.openstack.requestlog [None req-9f9d50d9-5d94-4ddf-8f08-364fe17a504c admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.529458 Aug 03 18:56:12.534441 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: [pid: 103584|app: 0|req: 15/31] 10.222.0.77 () {64 vars in 1282 bytes} [Wed Aug 3 18:56:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 18:56:12.547443 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-cbbf7115-5283-414a-a020-678bd1e401e7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:56:12.668080 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO nova.api.openstack.requestlog [None req-cbbf7115-5283-414a-a020-678bd1e401e7 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.124306 Aug 03 18:56:12.668670 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: [pid: 103583|app: 0|req: 17/32] 10.222.0.77 () {64 vars in 1332 bytes} [Wed Aug 3 18:56:12 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:56:14.904015 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-9f9d50d9-5d94-4ddf-8f08-364fe17a504c admin admin] Calling method '>' {{(pid=103584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:14.905022 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO nova.api.openstack.requestlog [None req-9f9d50d9-5d94-4ddf-8f08-364fe17a504c admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 03 18:56:14.905618 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: [pid: 103584|app: 0|req: 16/33] 10.222.0.77 () {54 vars in 930 bytes} [Wed Aug 3 18:56:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:56:15.361019 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-2d9d4a2c-2f15-40a4-ab96-b2295ccf337b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "name": "m1.xlarge", "swap": 0, "ram": 16384, "id": "5", "rxtx_factor": 1.0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:56:15.436238 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO nova.api.openstack.requestlog [None req-2d9d4a2c-2f15-40a4-ab96-b2295ccf337b admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.524602 Aug 03 18:56:15.437388 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: [pid: 103583|app: 0|req: 18/34] 10.222.0.77 () {64 vars in 1282 bytes} [Wed Aug 3 18:56:14 2022] POST /compute/v2.1/flavors => generated 408 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 18:56:15.449906 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-29e0f265-79bf-4ed9-b332-1682cf0a1aff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:56:15.454925 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG dbcounter [-] [103584] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:56:15.588968 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO nova.api.openstack.requestlog [None req-29e0f265-79bf-4ed9-b332-1682cf0a1aff admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.143008 Aug 03 18:56:15.589556 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: [pid: 103584|app: 0|req: 17/35] 10.222.0.77 () {64 vars in 1332 bytes} [Wed Aug 3 18:56:15 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:56:38.478363 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-2d9d4a2c-2f15-40a4-ab96-b2295ccf337b admin admin] Calling method '>' {{(pid=103583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:38.479478 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO nova.api.openstack.requestlog [None req-2d9d4a2c-2f15-40a4-ab96-b2295ccf337b admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 Aug 03 18:56:38.480652 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: [pid: 103583|app: 0|req: 19/36] 10.222.0.77 () {54 vars in 930 bytes} [Wed Aug 3 18:56:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:56:38.875112 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-e5e4679e-4fee-47bf-ae4e-aaa1731ce950 admin admin] Calling method '>' {{(pid=103584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:38.893413 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO nova.api.openstack.requestlog [None req-e5e4679e-4fee-47bf-ae4e-aaa1731ce950 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.406815 Aug 03 18:56:38.893881 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: [pid: 103584|app: 0|req: 18/37] 10.222.0.77 () {60 vars in 1291 bytes} [Wed Aug 3 18:56:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:56:39.954175 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-2d9d4a2c-2f15-40a4-ab96-b2295ccf337b admin admin] Calling method '>' {{(pid=103583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:39.955256 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO nova.api.openstack.requestlog [None req-2d9d4a2c-2f15-40a4-ab96-b2295ccf337b admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Aug 03 18:56:39.955672 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: [pid: 103583|app: 0|req: 20/38] 10.222.0.77 () {56 vars in 1074 bytes} [Wed Aug 3 18:56:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:56:40.497182 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-71bed206-d2ac-401a-acff-24bf0df23f53 admin admin] Calling method '>' {{(pid=103584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:40.502838 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO nova.api.openstack.wsgi [None req-71bed206-d2ac-401a-acff-24bf0df23f53 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 03 18:56:40.506145 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-71bed206-d2ac-401a-acff-24bf0df23f53 admin admin] Request method failure captured: Aug 03 18:56:40.506145 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 03 18:56:40.506145 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: Accept: application/json Aug 03 18:56:40.506145 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: Accept-Encoding: gzip, deflate Aug 03 18:56:40.506145 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: Connection: keep-alive Aug 03 18:56:40.506145 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: Content-Length: 0 Aug 03 18:56:40.506145 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: Host: 10.222.0.77 Aug 03 18:56:40.506145 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: Openstack-Api-Version: compute 2.90 Aug 03 18:56:40.506145 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: Openstack-System-Scope: None Aug 03 18:56:40.506145 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: User-Agent: python-novaclient Aug 03 18:56:40.506145 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Auth-Token: gAAAAABi6sTngmatgPf9OxxSjWz5oKCer0St6ypePTSBKP-GBdoiY0c9cVEcxXbikhIbBG2qhktxnk2Jcf7a5gXzOZGLyX7K6HeC1RzJiZsaF5-UVv0wlo2bAs2zvv9Iq2Uj-Lswiix6qKqqbIE1kPRrx1lcZ1OIhqqS4pOG1Aoc-E11wtuxi9s Aug 03 18:56:40.506145 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Domain-Id: None Aug 03 18:56:40.506145 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Domain-Name: None Aug 03 18:56:40.506145 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Identity-Status: Confirmed Aug 03 18:56:40.506145 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Is-Admin-Project: True Aug 03 18:56:40.506145 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 18:56:40.506145 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Project-Domain-Id: default Aug 03 18:56:40.506145 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Project-Domain-Name: Default Aug 03 18:56:40.506145 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Project-Id: 19da2c4b2a87499aba2f9deef7b1b4c1 Aug 03 18:56:40.506145 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Project-Name: admin Aug 03 18:56:40.506145 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Role: admin,reader,member Aug 03 18:56:40.506145 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Roles: admin,reader,member Aug 03 18:56:40.507865 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_19da2c4b2a87499aba2f9deef7b1b4c1", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/19da2c4b2a87499aba2f9deef7b1b4c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/19da2c4b2a87499aba2f9deef7b1b4c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/19da2c4b2a87499aba2f9deef7b1b4c1"}]}] Aug 03 18:56:40.507865 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Tenant: admin Aug 03 18:56:40.507865 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Tenant-Id: 19da2c4b2a87499aba2f9deef7b1b4c1 Aug 03 18:56:40.507865 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Tenant-Name: admin Aug 03 18:56:40.507865 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-User: admin Aug 03 18:56:40.507865 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-User-Domain-Id: default Aug 03 18:56:40.507865 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-User-Domain-Name: Default Aug 03 18:56:40.507865 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-User-Id: 9be9b3374c18495abc7088442b396fbf Aug 03 18:56:40.507865 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-User-Name: admin Aug 03 18:56:40.507865 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: method: > Aug 03 18:56:40.507865 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: exception: Flavor 42 could not be found. Aug 03 18:56:40.507865 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: action_args: {'id': '42'} Aug 03 18:56:40.507865 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: {{(pid=103584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 18:56:40.507865 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:56:40.508921 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 18:56:40.508921 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 18:56:40.508921 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 18:56:40.508921 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 18:56:40.508921 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 18:56:40.508921 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 18:56:40.508921 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 18:56:40.508921 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 18:56:40.508921 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 18:56:40.508921 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:56:40.508921 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 18:56:40.508921 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 18:56:40.508921 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 03 18:56:40.508921 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi Aug 03 18:56:40.508921 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:56:40.508921 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi Aug 03 18:56:40.508921 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:56:40.508921 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:56:40.508921 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:56:40.510341 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 18:56:40.510341 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 18:56:40.510341 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 18:56:40.510341 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:56:40.510341 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 18:56:40.510341 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 18:56:40.510341 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 03 18:56:40.510341 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi Aug 03 18:56:40.510341 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:56:40.510341 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi Aug 03 18:56:40.510341 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:56:40.510341 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:56:40.510341 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:56:40.510341 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 18:56:40.510341 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 18:56:40.510341 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 03 18:56:40.510341 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi Aug 03 18:56:40.510341 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-71bed206-d2ac-401a-acff-24bf0df23f53 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 18:56:40.511908 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO nova.api.openstack.requestlog [None req-71bed206-d2ac-401a-acff-24bf0df23f53 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.410132 Aug 03 18:56:40.511908 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: [pid: 103584|app: 0|req: 19/39] 10.222.0.77 () {60 vars in 1190 bytes} [Wed Aug 3 18:56:40 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 411 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 03 18:56:40.517838 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-1624b11d-cfbf-472d-8043-251be943bdbf admin admin] Calling method '>' {{(pid=103583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:40.521935 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG dbcounter [-] [103583] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:56:40.541181 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO nova.api.openstack.requestlog [None req-1624b11d-cfbf-472d-8043-251be943bdbf admin admin] 10.222.0.77 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027303 Aug 03 18:56:40.541728 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: [pid: 103583|app: 0|req: 21/40] 10.222.0.77 () {60 vars in 1210 bytes} [Wed Aug 3 18:56:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:56:40.552518 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-cef81bef-ee6b-45ff-af82-104b3faa6034 admin admin] Calling method '>' {{(pid=103584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:40.576339 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO nova.api.openstack.requestlog [None req-cef81bef-ee6b-45ff-af82-104b3faa6034 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027435 Aug 03 18:56:40.578978 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: [pid: 103584|app: 0|req: 20/41] 10.222.0.77 () {60 vars in 1210 bytes} [Wed Aug 3 18:56:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:56:40.587365 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-3eac2089-cd11-4fe8-93d5-df16d3ade343 admin admin] Calling method '>' {{(pid=103583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:40.593614 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO nova.api.openstack.wsgi [None req-3eac2089-cd11-4fe8-93d5-df16d3ade343 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 03 18:56:40.596838 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-3eac2089-cd11-4fe8-93d5-df16d3ade343 admin admin] Request method failure captured: Aug 03 18:56:40.596838 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 03 18:56:40.596838 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: Accept: application/json Aug 03 18:56:40.596838 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: Accept-Encoding: gzip, deflate Aug 03 18:56:40.596838 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: Connection: keep-alive Aug 03 18:56:40.596838 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: Content-Length: 0 Aug 03 18:56:40.596838 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: Host: 10.222.0.77 Aug 03 18:56:40.596838 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: Openstack-Api-Version: compute 2.90 Aug 03 18:56:40.596838 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: Openstack-System-Scope: None Aug 03 18:56:40.596838 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: User-Agent: python-novaclient Aug 03 18:56:40.596838 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Auth-Token: gAAAAABi6sTngmatgPf9OxxSjWz5oKCer0St6ypePTSBKP-GBdoiY0c9cVEcxXbikhIbBG2qhktxnk2Jcf7a5gXzOZGLyX7K6HeC1RzJiZsaF5-UVv0wlo2bAs2zvv9Iq2Uj-Lswiix6qKqqbIE1kPRrx1lcZ1OIhqqS4pOG1Aoc-E11wtuxi9s Aug 03 18:56:40.596838 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Domain-Id: None Aug 03 18:56:40.596838 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Domain-Name: None Aug 03 18:56:40.596838 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Identity-Status: Confirmed Aug 03 18:56:40.596838 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Is-Admin-Project: True Aug 03 18:56:40.596838 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 18:56:40.596838 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Project-Domain-Id: default Aug 03 18:56:40.596838 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Project-Domain-Name: Default Aug 03 18:56:40.596838 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Project-Id: 19da2c4b2a87499aba2f9deef7b1b4c1 Aug 03 18:56:40.596838 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Project-Name: admin Aug 03 18:56:40.596838 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Role: admin,reader,member Aug 03 18:56:40.596838 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Roles: admin,reader,member Aug 03 18:56:40.598715 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_19da2c4b2a87499aba2f9deef7b1b4c1", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/19da2c4b2a87499aba2f9deef7b1b4c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/19da2c4b2a87499aba2f9deef7b1b4c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/19da2c4b2a87499aba2f9deef7b1b4c1"}]}] Aug 03 18:56:40.598715 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Tenant: admin Aug 03 18:56:40.598715 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Tenant-Id: 19da2c4b2a87499aba2f9deef7b1b4c1 Aug 03 18:56:40.598715 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Tenant-Name: admin Aug 03 18:56:40.598715 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-User: admin Aug 03 18:56:40.598715 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-User-Domain-Id: default Aug 03 18:56:40.598715 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-User-Domain-Name: Default Aug 03 18:56:40.598715 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-User-Id: 9be9b3374c18495abc7088442b396fbf Aug 03 18:56:40.598715 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-User-Name: admin Aug 03 18:56:40.598715 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: method: > Aug 03 18:56:40.598715 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: exception: Flavor 42 could not be found. Aug 03 18:56:40.598715 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: action_args: {'id': '42'} Aug 03 18:56:40.598715 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: {{(pid=103583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 18:56:40.598715 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:56:40.599908 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 18:56:40.599908 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 18:56:40.599908 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 18:56:40.599908 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 18:56:40.599908 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 18:56:40.599908 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 18:56:40.599908 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 18:56:40.599908 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 18:56:40.599908 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 18:56:40.599908 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:56:40.599908 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 18:56:40.599908 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 18:56:40.599908 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 03 18:56:40.599908 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi Aug 03 18:56:40.599908 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:56:40.599908 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi Aug 03 18:56:40.599908 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:56:40.599908 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:56:40.599908 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:56:40.601200 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 18:56:40.601200 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 18:56:40.601200 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 18:56:40.601200 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:56:40.601200 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 18:56:40.601200 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 18:56:40.601200 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 03 18:56:40.601200 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi Aug 03 18:56:40.601200 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:56:40.601200 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi Aug 03 18:56:40.601200 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:56:40.601200 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:56:40.601200 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:56:40.601200 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 18:56:40.601200 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 18:56:40.601200 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 03 18:56:40.601200 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi Aug 03 18:56:40.601200 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-3eac2089-cd11-4fe8-93d5-df16d3ade343 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 18:56:40.602791 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO nova.api.openstack.requestlog [None req-3eac2089-cd11-4fe8-93d5-df16d3ade343 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014768 Aug 03 18:56:40.602791 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: [pid: 103583|app: 0|req: 22/42] 10.222.0.77 () {60 vars in 1190 bytes} [Wed Aug 3 18:56:40 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 03 18:56:41.699125 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-cef81bef-ee6b-45ff-af82-104b3faa6034 admin admin] Calling method '>' {{(pid=103584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:41.700126 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO nova.api.openstack.requestlog [None req-cef81bef-ee6b-45ff-af82-104b3faa6034 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Aug 03 18:56:41.700509 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: [pid: 103584|app: 0|req: 21/43] 10.222.0.77 () {56 vars in 1074 bytes} [Wed Aug 3 18:56:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:56:42.222796 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-cb19e0be-81d3-4db1-9780-0eb4c609d65f admin admin] Calling method '>' {{(pid=103583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:42.228597 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO nova.api.openstack.wsgi [None req-cb19e0be-81d3-4db1-9780-0eb4c609d65f admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 03 18:56:42.230237 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-cb19e0be-81d3-4db1-9780-0eb4c609d65f admin admin] Request method failure captured: Aug 03 18:56:42.230237 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 03 18:56:42.230237 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: Accept: application/json Aug 03 18:56:42.230237 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: Accept-Encoding: gzip, deflate Aug 03 18:56:42.230237 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: Connection: keep-alive Aug 03 18:56:42.230237 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: Content-Length: 0 Aug 03 18:56:42.230237 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: Host: 10.222.0.77 Aug 03 18:56:42.230237 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: Openstack-Api-Version: compute 2.90 Aug 03 18:56:42.230237 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: Openstack-System-Scope: None Aug 03 18:56:42.230237 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: User-Agent: python-novaclient Aug 03 18:56:42.230237 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Auth-Token: gAAAAABi6sTpVx90gLQ3JW_rYUu2Zab7QEAVYVJAQEWephSJJtWcogjm3pAl5F7BuhC2MlXOTIZz4jNfBW5W3QUWUoi1rTArZtyCDGKS7fUBShxdvGHRMcxR7jdIqclonKqwFjW0FWNJF3iTXUmzP2R_iF2EzFb8Fzk5D7Aa92v4SxQkzSJKY8Q Aug 03 18:56:42.230237 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Domain-Id: None Aug 03 18:56:42.230237 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Domain-Name: None Aug 03 18:56:42.230237 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Identity-Status: Confirmed Aug 03 18:56:42.230237 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Is-Admin-Project: True Aug 03 18:56:42.230237 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 18:56:42.230237 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Project-Domain-Id: default Aug 03 18:56:42.230237 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Project-Domain-Name: Default Aug 03 18:56:42.230237 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Project-Id: 19da2c4b2a87499aba2f9deef7b1b4c1 Aug 03 18:56:42.230237 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Project-Name: admin Aug 03 18:56:42.230237 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Role: admin,reader,member Aug 03 18:56:42.230237 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Roles: admin,reader,member Aug 03 18:56:42.231876 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_19da2c4b2a87499aba2f9deef7b1b4c1", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/19da2c4b2a87499aba2f9deef7b1b4c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/19da2c4b2a87499aba2f9deef7b1b4c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/19da2c4b2a87499aba2f9deef7b1b4c1"}]}] Aug 03 18:56:42.231876 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Tenant: admin Aug 03 18:56:42.231876 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Tenant-Id: 19da2c4b2a87499aba2f9deef7b1b4c1 Aug 03 18:56:42.231876 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Tenant-Name: admin Aug 03 18:56:42.231876 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-User: admin Aug 03 18:56:42.231876 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-User-Domain-Id: default Aug 03 18:56:42.231876 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-User-Domain-Name: Default Aug 03 18:56:42.231876 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-User-Id: 9be9b3374c18495abc7088442b396fbf Aug 03 18:56:42.231876 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-User-Name: admin Aug 03 18:56:42.231876 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: method: > Aug 03 18:56:42.231876 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: exception: Flavor 84 could not be found. Aug 03 18:56:42.231876 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: action_args: {'id': '84'} Aug 03 18:56:42.231876 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: {{(pid=103583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 18:56:42.231876 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:56:42.233964 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 18:56:42.233964 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 18:56:42.233964 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 18:56:42.233964 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 18:56:42.233964 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 18:56:42.233964 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 18:56:42.233964 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 18:56:42.233964 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 18:56:42.233964 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 18:56:42.233964 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:56:42.233964 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 18:56:42.233964 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 18:56:42.233964 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 03 18:56:42.233964 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi Aug 03 18:56:42.233964 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:56:42.233964 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi Aug 03 18:56:42.233964 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:56:42.233964 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:56:42.233964 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:56:42.235325 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 18:56:42.235325 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 18:56:42.235325 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 18:56:42.235325 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:56:42.235325 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 18:56:42.235325 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 18:56:42.235325 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 03 18:56:42.235325 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi Aug 03 18:56:42.235325 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:56:42.235325 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi Aug 03 18:56:42.235325 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:56:42.235325 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:56:42.235325 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:56:42.235325 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 18:56:42.235325 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 18:56:42.235325 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 03 18:56:42.235325 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi Aug 03 18:56:42.235325 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-cb19e0be-81d3-4db1-9780-0eb4c609d65f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 18:56:42.236601 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO nova.api.openstack.requestlog [None req-cb19e0be-81d3-4db1-9780-0eb4c609d65f admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.392758 Aug 03 18:56:42.236601 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: [pid: 103583|app: 0|req: 23/44] 10.222.0.77 () {60 vars in 1190 bytes} [Wed Aug 3 18:56:41 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 03 18:56:42.242287 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-781755d8-2cd3-4335-8533-4b301ffd90c0 admin admin] Calling method '>' {{(pid=103584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:42.257541 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO nova.api.openstack.requestlog [None req-781755d8-2cd3-4335-8533-4b301ffd90c0 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018808 Aug 03 18:56:42.258111 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: [pid: 103584|app: 0|req: 22/45] 10.222.0.77 () {60 vars in 1210 bytes} [Wed Aug 3 18:56:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 18:56:42.268538 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-56a02d18-55d7-4cf1-b468-94687ec42cac admin admin] Calling method '>' {{(pid=103583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:42.285435 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO nova.api.openstack.requestlog [None req-56a02d18-55d7-4cf1-b468-94687ec42cac admin admin] 10.222.0.77 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020648 Aug 03 18:56:42.285960 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: [pid: 103583|app: 0|req: 24/46] 10.222.0.77 () {60 vars in 1210 bytes} [Wed Aug 3 18:56:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:56:42.295374 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-1342eccb-b106-4ff6-9005-637244cc0130 admin admin] Calling method '>' {{(pid=103584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:42.300663 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO nova.api.openstack.wsgi [None req-1342eccb-b106-4ff6-9005-637244cc0130 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 03 18:56:42.302245 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-1342eccb-b106-4ff6-9005-637244cc0130 admin admin] Request method failure captured: Aug 03 18:56:42.302245 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 03 18:56:42.302245 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: Accept: application/json Aug 03 18:56:42.302245 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: Accept-Encoding: gzip, deflate Aug 03 18:56:42.302245 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: Connection: keep-alive Aug 03 18:56:42.302245 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: Content-Length: 0 Aug 03 18:56:42.302245 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: Host: 10.222.0.77 Aug 03 18:56:42.302245 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: Openstack-Api-Version: compute 2.90 Aug 03 18:56:42.302245 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: Openstack-System-Scope: None Aug 03 18:56:42.302245 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: User-Agent: python-novaclient Aug 03 18:56:42.302245 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Auth-Token: gAAAAABi6sTpVx90gLQ3JW_rYUu2Zab7QEAVYVJAQEWephSJJtWcogjm3pAl5F7BuhC2MlXOTIZz4jNfBW5W3QUWUoi1rTArZtyCDGKS7fUBShxdvGHRMcxR7jdIqclonKqwFjW0FWNJF3iTXUmzP2R_iF2EzFb8Fzk5D7Aa92v4SxQkzSJKY8Q Aug 03 18:56:42.302245 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Domain-Id: None Aug 03 18:56:42.302245 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Domain-Name: None Aug 03 18:56:42.302245 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Identity-Status: Confirmed Aug 03 18:56:42.302245 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Is-Admin-Project: True Aug 03 18:56:42.302245 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 18:56:42.302245 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Project-Domain-Id: default Aug 03 18:56:42.302245 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Project-Domain-Name: Default Aug 03 18:56:42.302245 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Project-Id: 19da2c4b2a87499aba2f9deef7b1b4c1 Aug 03 18:56:42.302245 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Project-Name: admin Aug 03 18:56:42.302245 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Role: admin,reader,member Aug 03 18:56:42.302245 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Roles: admin,reader,member Aug 03 18:56:42.303672 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_19da2c4b2a87499aba2f9deef7b1b4c1", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/19da2c4b2a87499aba2f9deef7b1b4c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/19da2c4b2a87499aba2f9deef7b1b4c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/19da2c4b2a87499aba2f9deef7b1b4c1"}]}] Aug 03 18:56:42.303672 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Tenant: admin Aug 03 18:56:42.303672 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Tenant-Id: 19da2c4b2a87499aba2f9deef7b1b4c1 Aug 03 18:56:42.303672 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Tenant-Name: admin Aug 03 18:56:42.303672 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-User: admin Aug 03 18:56:42.303672 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-User-Domain-Id: default Aug 03 18:56:42.303672 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-User-Domain-Name: Default Aug 03 18:56:42.303672 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-User-Id: 9be9b3374c18495abc7088442b396fbf Aug 03 18:56:42.303672 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-User-Name: admin Aug 03 18:56:42.303672 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: method: > Aug 03 18:56:42.303672 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: exception: Flavor 84 could not be found. Aug 03 18:56:42.303672 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: action_args: {'id': '84'} Aug 03 18:56:42.303672 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: {{(pid=103584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 18:56:42.303672 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:56:42.304578 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 18:56:42.304578 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 18:56:42.304578 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 18:56:42.304578 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 18:56:42.304578 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 18:56:42.304578 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 18:56:42.304578 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 18:56:42.304578 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 18:56:42.304578 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 18:56:42.304578 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:56:42.304578 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 18:56:42.304578 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 18:56:42.304578 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 03 18:56:42.304578 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi Aug 03 18:56:42.304578 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:56:42.304578 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi Aug 03 18:56:42.304578 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:56:42.304578 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:56:42.304578 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:56:42.305871 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 18:56:42.305871 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 18:56:42.305871 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 18:56:42.305871 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:56:42.305871 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 18:56:42.305871 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 18:56:42.305871 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 03 18:56:42.305871 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi Aug 03 18:56:42.305871 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:56:42.305871 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi Aug 03 18:56:42.305871 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:56:42.305871 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:56:42.305871 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:56:42.305871 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 18:56:42.305871 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 18:56:42.305871 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 03 18:56:42.305871 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi Aug 03 18:56:42.305871 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-1342eccb-b106-4ff6-9005-637244cc0130 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 18:56:42.307228 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO nova.api.openstack.requestlog [None req-1342eccb-b106-4ff6-9005-637244cc0130 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011873 Aug 03 18:56:42.307228 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: [pid: 103584|app: 0|req: 23/47] 10.222.0.77 () {60 vars in 1190 bytes} [Wed Aug 3 18:56:42 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 03 18:56:43.279800 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-56a02d18-55d7-4cf1-b468-94687ec42cac admin admin] Calling method '>' {{(pid=103583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:43.281319 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO nova.api.openstack.requestlog [None req-56a02d18-55d7-4cf1-b468-94687ec42cac admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 03 18:56:43.281711 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: [pid: 103583|app: 0|req: 25/48] 10.222.0.77 () {56 vars in 1074 bytes} [Wed Aug 3 18:56:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:56:43.807251 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-55cb7197-658b-477a-8671-737029129878 admin admin] Calling method '>' {{(pid=103584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:43.813672 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO nova.api.openstack.wsgi [None req-55cb7197-658b-477a-8671-737029129878 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 03 18:56:43.815209 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-55cb7197-658b-477a-8671-737029129878 admin admin] Request method failure captured: Aug 03 18:56:43.815209 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 03 18:56:43.815209 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: Accept: application/json Aug 03 18:56:43.815209 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: Accept-Encoding: gzip, deflate Aug 03 18:56:43.815209 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: Connection: keep-alive Aug 03 18:56:43.815209 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: Content-Length: 0 Aug 03 18:56:43.815209 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: Host: 10.222.0.77 Aug 03 18:56:43.815209 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: Openstack-Api-Version: compute 2.90 Aug 03 18:56:43.815209 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: Openstack-System-Scope: None Aug 03 18:56:43.815209 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: User-Agent: python-novaclient Aug 03 18:56:43.815209 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Auth-Token: gAAAAABi6sTrD8n7eYPe9XzYY7PUO9p0qq0V_G5YzqpPJSadPaN5P3GKGLmbg5iVe4fOESqdoYmwsXeaV-G68r_GuvBgHCORLZ2-yOFXD3ZfHK03CpmXPr6BGjIQghGgattRFL_IoHE1GpgRfJI0tqih--39FqPEKFCQs_JgyehnUclgqRqJ7fk Aug 03 18:56:43.815209 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Domain-Id: None Aug 03 18:56:43.815209 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Domain-Name: None Aug 03 18:56:43.815209 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Identity-Status: Confirmed Aug 03 18:56:43.815209 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Is-Admin-Project: True Aug 03 18:56:43.815209 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 18:56:43.815209 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Project-Domain-Id: default Aug 03 18:56:43.815209 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Project-Domain-Name: Default Aug 03 18:56:43.815209 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Project-Id: 19da2c4b2a87499aba2f9deef7b1b4c1 Aug 03 18:56:43.815209 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Project-Name: admin Aug 03 18:56:43.815209 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Role: admin,reader,member Aug 03 18:56:43.815209 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Roles: admin,reader,member Aug 03 18:56:43.816808 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_19da2c4b2a87499aba2f9deef7b1b4c1", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/19da2c4b2a87499aba2f9deef7b1b4c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/19da2c4b2a87499aba2f9deef7b1b4c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/19da2c4b2a87499aba2f9deef7b1b4c1"}]}] Aug 03 18:56:43.816808 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Tenant: admin Aug 03 18:56:43.816808 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Tenant-Id: 19da2c4b2a87499aba2f9deef7b1b4c1 Aug 03 18:56:43.816808 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-Tenant-Name: admin Aug 03 18:56:43.816808 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-User: admin Aug 03 18:56:43.816808 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-User-Domain-Id: default Aug 03 18:56:43.816808 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-User-Domain-Name: Default Aug 03 18:56:43.816808 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-User-Id: 9be9b3374c18495abc7088442b396fbf Aug 03 18:56:43.816808 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: X-User-Name: admin Aug 03 18:56:43.816808 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: method: > Aug 03 18:56:43.816808 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: exception: Flavor 451 could not be found. Aug 03 18:56:43.816808 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: action_args: {'id': '451'} Aug 03 18:56:43.816808 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: {{(pid=103584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 18:56:43.816808 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:56:43.818097 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 18:56:43.818097 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 18:56:43.818097 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 18:56:43.818097 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 18:56:43.818097 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 18:56:43.818097 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 18:56:43.818097 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 18:56:43.818097 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 18:56:43.818097 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 18:56:43.818097 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:56:43.818097 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 18:56:43.818097 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 18:56:43.818097 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 03 18:56:43.818097 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi Aug 03 18:56:43.818097 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:56:43.818097 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi Aug 03 18:56:43.818097 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:56:43.818097 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:56:43.818097 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:56:43.819553 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 18:56:43.819553 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 18:56:43.819553 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 18:56:43.819553 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:56:43.819553 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 18:56:43.819553 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 18:56:43.819553 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 03 18:56:43.819553 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi Aug 03 18:56:43.819553 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:56:43.819553 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi Aug 03 18:56:43.819553 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:56:43.819553 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:56:43.819553 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:56:43.819553 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 18:56:43.819553 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 18:56:43.819553 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 03 18:56:43.819553 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: ERROR nova.api.openstack.wsgi Aug 03 18:56:43.819553 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-55cb7197-658b-477a-8671-737029129878 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 18:56:43.821125 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO nova.api.openstack.requestlog [None req-55cb7197-658b-477a-8671-737029129878 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.396127 Aug 03 18:56:43.821125 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: [pid: 103584|app: 0|req: 24/49] 10.222.0.77 () {60 vars in 1193 bytes} [Wed Aug 3 18:56:43 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 03 18:56:43.826240 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-26440920-0d57-471f-804a-c2647dea03b6 admin admin] Calling method '>' {{(pid=103583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:43.841311 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO nova.api.openstack.requestlog [None req-26440920-0d57-471f-804a-c2647dea03b6 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018631 Aug 03 18:56:43.841873 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: [pid: 103583|app: 0|req: 26/50] 10.222.0.77 () {60 vars in 1210 bytes} [Wed Aug 3 18:56:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:56:43.851320 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-36b01917-f494-42e8-84fa-8d1f05ee8536 admin admin] Calling method '>' {{(pid=103584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:43.873401 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO nova.api.openstack.requestlog [None req-36b01917-f494-42e8-84fa-8d1f05ee8536 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025590 Aug 03 18:56:43.873959 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: [pid: 103584|app: 0|req: 25/51] 10.222.0.77 () {60 vars in 1210 bytes} [Wed Aug 3 18:56:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:56:43.884751 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-6b9127b2-5395-4b68-ba0b-1e9689aa8f0a admin admin] Calling method '>' {{(pid=103583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:43.890218 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO nova.api.openstack.wsgi [None req-6b9127b2-5395-4b68-ba0b-1e9689aa8f0a admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 03 18:56:43.891976 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-6b9127b2-5395-4b68-ba0b-1e9689aa8f0a admin admin] Request method failure captured: Aug 03 18:56:43.891976 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 03 18:56:43.891976 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: Accept: application/json Aug 03 18:56:43.891976 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: Accept-Encoding: gzip, deflate Aug 03 18:56:43.891976 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: Connection: keep-alive Aug 03 18:56:43.891976 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: Content-Length: 0 Aug 03 18:56:43.891976 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: Host: 10.222.0.77 Aug 03 18:56:43.891976 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: Openstack-Api-Version: compute 2.90 Aug 03 18:56:43.891976 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: Openstack-System-Scope: None Aug 03 18:56:43.891976 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: User-Agent: python-novaclient Aug 03 18:56:43.891976 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Auth-Token: gAAAAABi6sTrD8n7eYPe9XzYY7PUO9p0qq0V_G5YzqpPJSadPaN5P3GKGLmbg5iVe4fOESqdoYmwsXeaV-G68r_GuvBgHCORLZ2-yOFXD3ZfHK03CpmXPr6BGjIQghGgattRFL_IoHE1GpgRfJI0tqih--39FqPEKFCQs_JgyehnUclgqRqJ7fk Aug 03 18:56:43.891976 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Domain-Id: None Aug 03 18:56:43.891976 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Domain-Name: None Aug 03 18:56:43.891976 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Identity-Status: Confirmed Aug 03 18:56:43.891976 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Is-Admin-Project: True Aug 03 18:56:43.891976 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 18:56:43.891976 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Project-Domain-Id: default Aug 03 18:56:43.891976 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Project-Domain-Name: Default Aug 03 18:56:43.891976 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Project-Id: 19da2c4b2a87499aba2f9deef7b1b4c1 Aug 03 18:56:43.891976 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Project-Name: admin Aug 03 18:56:43.891976 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Role: admin,reader,member Aug 03 18:56:43.891976 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Roles: admin,reader,member Aug 03 18:56:43.893551 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_19da2c4b2a87499aba2f9deef7b1b4c1", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/19da2c4b2a87499aba2f9deef7b1b4c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/19da2c4b2a87499aba2f9deef7b1b4c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/19da2c4b2a87499aba2f9deef7b1b4c1"}]}] Aug 03 18:56:43.893551 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Tenant: admin Aug 03 18:56:43.893551 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Tenant-Id: 19da2c4b2a87499aba2f9deef7b1b4c1 Aug 03 18:56:43.893551 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-Tenant-Name: admin Aug 03 18:56:43.893551 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-User: admin Aug 03 18:56:43.893551 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-User-Domain-Id: default Aug 03 18:56:43.893551 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-User-Domain-Name: Default Aug 03 18:56:43.893551 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-User-Id: 9be9b3374c18495abc7088442b396fbf Aug 03 18:56:43.893551 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: X-User-Name: admin Aug 03 18:56:43.893551 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: method: > Aug 03 18:56:43.893551 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: exception: Flavor 451 could not be found. Aug 03 18:56:43.893551 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: action_args: {'id': '451'} Aug 03 18:56:43.893551 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: {{(pid=103583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 18:56:43.893551 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:56:43.894384 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 18:56:43.894384 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 18:56:43.894384 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 18:56:43.894384 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 18:56:43.894384 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 18:56:43.894384 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 18:56:43.894384 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 18:56:43.894384 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 18:56:43.894384 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 18:56:43.894384 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:56:43.894384 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 18:56:43.894384 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 18:56:43.894384 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 03 18:56:43.894384 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi Aug 03 18:56:43.894384 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:56:43.894384 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi Aug 03 18:56:43.894384 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:56:43.894384 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:56:43.894384 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:56:43.895589 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 18:56:43.895589 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 18:56:43.895589 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 18:56:43.895589 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:56:43.895589 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 18:56:43.895589 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 18:56:43.895589 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 03 18:56:43.895589 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi Aug 03 18:56:43.895589 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:56:43.895589 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi Aug 03 18:56:43.895589 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:56:43.895589 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:56:43.895589 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:56:43.895589 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 18:56:43.895589 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 18:56:43.895589 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 03 18:56:43.895589 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: ERROR nova.api.openstack.wsgi Aug 03 18:56:43.895589 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-6b9127b2-5395-4b68-ba0b-1e9689aa8f0a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 18:56:43.896816 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO nova.api.openstack.requestlog [None req-6b9127b2-5395-4b68-ba0b-1e9689aa8f0a admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012071 Aug 03 18:56:43.896816 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: [pid: 103583|app: 0|req: 27/52] 10.222.0.77 () {60 vars in 1193 bytes} [Wed Aug 3 18:56:43 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 03 18:56:44.859083 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-36b01917-f494-42e8-84fa-8d1f05ee8536 admin admin] Calling method '>' {{(pid=103584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:44.860089 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO nova.api.openstack.requestlog [None req-36b01917-f494-42e8-84fa-8d1f05ee8536 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 03 18:56:44.860486 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: [pid: 103584|app: 0|req: 26/53] 10.222.0.77 () {56 vars in 1074 bytes} [Wed Aug 3 18:56:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:56:45.387952 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-806d9aac-068f-47a3-bf43-c1ca857f8899 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:56:45.589553 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO nova.api.openstack.requestlog [None req-806d9aac-068f-47a3-bf43-c1ca857f8899 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.589303 Aug 03 18:56:45.590192 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: [pid: 103583|app: 0|req: 28/54] 10.222.0.77 () {64 vars in 1235 bytes} [Wed Aug 3 18:56:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 18:56:46.566583 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-36b01917-f494-42e8-84fa-8d1f05ee8536 admin admin] Calling method '>' {{(pid=103584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:46.567650 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO nova.api.openstack.requestlog [None req-36b01917-f494-42e8-84fa-8d1f05ee8536 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Aug 03 18:56:46.568044 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: [pid: 103584|app: 0|req: 27/55] 10.222.0.77 () {56 vars in 1074 bytes} [Wed Aug 3 18:56:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:56:47.099086 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-c1ac1842-3e46-4afc-a2d0-0cfd7f6cb8d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:56:47.171647 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO nova.api.openstack.requestlog [None req-c1ac1842-3e46-4afc-a2d0-0cfd7f6cb8d2 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.463504 Aug 03 18:56:47.172182 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: [pid: 103583|app: 0|req: 29/56] 10.222.0.77 () {64 vars in 1235 bytes} [Wed Aug 3 18:56:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 18:56:48.146291 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-36b01917-f494-42e8-84fa-8d1f05ee8536 admin admin] Calling method '>' {{(pid=103584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:48.147340 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO nova.api.openstack.requestlog [None req-36b01917-f494-42e8-84fa-8d1f05ee8536 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Aug 03 18:56:48.147733 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: [pid: 103584|app: 0|req: 28/57] 10.222.0.77 () {56 vars in 1074 bytes} [Wed Aug 3 18:56:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:56:48.672342 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-1322e371-528d-4328-934f-e5777ce02e4c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:56:48.743626 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO nova.api.openstack.requestlog [None req-1322e371-528d-4328-934f-e5777ce02e4c admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.455674 Aug 03 18:56:48.744165 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: [pid: 103583|app: 0|req: 30/58] 10.222.0.77 () {64 vars in 1235 bytes} [Wed Aug 3 18:56:48 2022] POST /compute/v2.1/flavors => generated 407 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 18:56:49.721989 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-36b01917-f494-42e8-84fa-8d1f05ee8536 admin admin] Calling method '>' {{(pid=103584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:49.723029 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO nova.api.openstack.requestlog [None req-36b01917-f494-42e8-84fa-8d1f05ee8536 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Aug 03 18:56:49.723425 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: [pid: 103584|app: 0|req: 29/59] 10.222.0.77 () {56 vars in 1074 bytes} [Wed Aug 3 18:56:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:56:50.244482 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-b54cc146-3aac-4974-a23e-86a8990c7e1b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:56:50.332084 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO nova.api.openstack.requestlog [None req-b54cc146-3aac-4974-a23e-86a8990c7e1b admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.468430 Aug 03 18:56:50.332659 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: [pid: 103583|app: 0|req: 31/60] 10.222.0.77 () {64 vars in 1235 bytes} [Wed Aug 3 18:56:49 2022] POST /compute/v2.1/flavors => generated 409 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 18:56:51.301623 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-36b01917-f494-42e8-84fa-8d1f05ee8536 admin admin] Calling method '>' {{(pid=103584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:51.302759 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO nova.api.openstack.requestlog [None req-36b01917-f494-42e8-84fa-8d1f05ee8536 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001586 Aug 03 18:56:51.303207 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: [pid: 103584|app: 0|req: 30/61] 10.222.0.77 () {56 vars in 1074 bytes} [Wed Aug 3 18:56:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:56:51.829880 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-4190ea6a-08ee-46df-8663-a7958bb73a7b admin admin] Calling method '>' {{(pid=103583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:51.852082 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO nova.api.openstack.requestlog [None req-4190ea6a-08ee-46df-8663-a7958bb73a7b admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.410265 Aug 03 18:56:51.852616 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: [pid: 103583|app: 0|req: 32/62] 10.222.0.77 () {60 vars in 1202 bytes} [Wed Aug 3 18:56:51 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:57:43.557185 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-36b01917-f494-42e8-84fa-8d1f05ee8536 admin admin] Calling method '>' {{(pid=103584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:43.559046 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO nova.api.openstack.requestlog [None req-36b01917-f494-42e8-84fa-8d1f05ee8536 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002113 Aug 03 18:57:43.559447 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: [pid: 103584|app: 0|req: 31/63] 10.222.0.77 () {54 vars in 930 bytes} [Wed Aug 3 18:57:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:57:43.569760 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG dbcounter [-] [103583] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:57:43.960228 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-203d1a63-5ae1-47d9-a02e-819596575433 admin admin] Calling method '>' {{(pid=103583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:43.981821 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO nova.api.openstack.requestlog [None req-203d1a63-5ae1-47d9-a02e-819596575433 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.416567 Aug 03 18:57:43.982281 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: [pid: 103583|app: 0|req: 33/64] 10.222.0.77 () {60 vars in 1291 bytes} [Wed Aug 3 18:57:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:57:44.003863 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG dbcounter [-] [103584] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:57:44.007687 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-1a6c0749-84cf-4150-9b6e-0e8706c4ba67 admin admin] Calling method '>' {{(pid=103584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:44.015541 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO nova.api.openstack.requestlog [None req-1a6c0749-84cf-4150-9b6e-0e8706c4ba67 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013134 Aug 03 18:57:44.016058 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: [pid: 103584|app: 0|req: 32/65] 10.222.0.77 () {60 vars in 1282 bytes} [Wed Aug 3 18:57:44 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:57:44.028647 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-779c80b8-5560-4c18-bbbb-a91cc4e33298 admin admin] Calling method '>' {{(pid=103583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:44.036298 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO nova.api.openstack.requestlog [None req-779c80b8-5560-4c18-bbbb-a91cc4e33298 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012037 Aug 03 18:57:44.036807 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: [pid: 103583|app: 0|req: 34/66] 10.222.0.77 () {60 vars in 1285 bytes} [Wed Aug 3 18:57:44 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:57:44.049028 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-5724266f-8aff-4861-a2c0-66349188378a admin admin] Calling method '>' {{(pid=103584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:44.057035 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO nova.api.openstack.requestlog [None req-5724266f-8aff-4861-a2c0-66349188378a admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011922 Aug 03 18:57:44.057634 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: [pid: 103584|app: 0|req: 33/67] 10.222.0.77 () {60 vars in 1285 bytes} [Wed Aug 3 18:57:44 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:57:44.068998 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-afbc9686-9db4-4057-9d1f-e98ce1482ef5 admin admin] Calling method '>' {{(pid=103583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:44.076908 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO nova.api.openstack.requestlog [None req-afbc9686-9db4-4057-9d1f-e98ce1482ef5 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011417 Aug 03 18:57:44.077430 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: [pid: 103583|app: 0|req: 35/68] 10.222.0.77 () {60 vars in 1282 bytes} [Wed Aug 3 18:57:44 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:00:55.752461 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-5724266f-8aff-4861-a2c0-66349188378a admin admin] Calling method '>' {{(pid=103584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:55.753496 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO nova.api.openstack.requestlog [None req-5724266f-8aff-4861-a2c0-66349188378a admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 03 19:00:55.753916 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: [pid: 103584|app: 0|req: 34/69] 10.222.0.77 () {56 vars in 1074 bytes} [Wed Aug 3 19:00:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:00:55.902890 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG dbcounter [-] [103583] Writing DB stats nova_api:SELECT=6 {{(pid=103583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:00:56.066853 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-0489d1cd-70fe-4952-a970-11c4451784b1 admin admin] Calling method '>' {{(pid=103583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:56.069194 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 19:00:56.069194 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: warnings.warn(msg) Aug 03 19:00:56.070428 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG oslo_concurrency.lockutils [None req-0489d1cd-70fe-4952-a970-11c4451784b1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:56.070921 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG oslo_concurrency.lockutils [None req-0489d1cd-70fe-4952-a970-11c4451784b1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:56.071723 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG oslo_concurrency.lockutils [None req-0489d1cd-70fe-4952-a970-11c4451784b1 admin admin] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:56.072152 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG oslo_concurrency.lockutils [None req-0489d1cd-70fe-4952-a970-11c4451784b1 admin admin] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:56.106791 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO nova.api.openstack.requestlog [None req-0489d1cd-70fe-4952-a970-11c4451784b1 admin admin] 10.222.0.77 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.205397 Aug 03 19:00:56.107400 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: [pid: 103583|app: 0|req: 36/70] 10.222.0.77 () {60 vars in 1193 bytes} [Wed Aug 3 19:00:55 2022] GET /compute/v2.1/os-services => generated 791 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 19:00:56.957455 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-5724266f-8aff-4861-a2c0-66349188378a admin admin] Calling method '>' {{(pid=103584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:56.958456 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO nova.api.openstack.requestlog [None req-5724266f-8aff-4861-a2c0-66349188378a admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Aug 03 19:00:56.958848 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: [pid: 103584|app: 0|req: 35/71] 10.222.0.77 () {56 vars in 1074 bytes} [Wed Aug 3 19:00:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 19:00:57.166125 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-a3590d22-79a4-4051-9851-0e73aa64881c admin admin] Calling method '>' {{(pid=103583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:57.168628 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 19:00:57.168628 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: warnings.warn(msg) Aug 03 19:00:57.169959 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG oslo_concurrency.lockutils [None req-a3590d22-79a4-4051-9851-0e73aa64881c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:57.170577 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG oslo_concurrency.lockutils [None req-a3590d22-79a4-4051-9851-0e73aa64881c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:57.171426 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG oslo_concurrency.lockutils [None req-a3590d22-79a4-4051-9851-0e73aa64881c admin admin] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:57.171864 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG oslo_concurrency.lockutils [None req-a3590d22-79a4-4051-9851-0e73aa64881c admin admin] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:57.191551 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO nova.api.openstack.requestlog [None req-a3590d22-79a4-4051-9851-0e73aa64881c admin admin] 10.222.0.77 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.091720 Aug 03 19:00:57.192124 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: [pid: 103583|app: 0|req: 37/72] 10.222.0.77 () {60 vars in 1193 bytes} [Wed Aug 3 19:00:57 2022] GET /compute/v2.1/os-services => generated 791 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 19:01:08.471314 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-5724266f-8aff-4861-a2c0-66349188378a admin admin] Calling method '>' {{(pid=103584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:08.472881 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO nova.api.openstack.requestlog [None req-5724266f-8aff-4861-a2c0-66349188378a admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001909 Aug 03 19:01:08.473305 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: [pid: 103584|app: 0|req: 36/73] 10.222.0.77 () {56 vars in 1074 bytes} [Wed Aug 3 19:01:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:01:08.620883 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG dbcounter [-] [103583] Writing DB stats nova_cell0:SELECT=4 {{(pid=103583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:01:08.621516 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG dbcounter [-] [103583] Writing DB stats nova_cell1:SELECT=4 {{(pid=103583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:01:08.622413 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG dbcounter [-] [103583] Writing DB stats nova_api:SELECT=8 {{(pid=103583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:01:08.674180 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-dd4c4171-7523-4de5-a601-a6e2e4a1e2e6 admin admin] Calling method '>' {{(pid=103583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:08.676722 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 19:01:08.676722 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: warnings.warn(msg) Aug 03 19:01:08.677912 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG oslo_concurrency.lockutils [None req-dd4c4171-7523-4de5-a601-a6e2e4a1e2e6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:08.678345 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG oslo_concurrency.lockutils [None req-dd4c4171-7523-4de5-a601-a6e2e4a1e2e6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:08.679153 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG oslo_concurrency.lockutils [None req-dd4c4171-7523-4de5-a601-a6e2e4a1e2e6 admin admin] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:08.679575 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG oslo_concurrency.lockutils [None req-dd4c4171-7523-4de5-a601-a6e2e4a1e2e6 admin admin] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:08.705759 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO nova.api.openstack.requestlog [None req-dd4c4171-7523-4de5-a601-a6e2e4a1e2e6 admin admin] 10.222.0.77 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.089327 Aug 03 19:01:08.706322 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: [pid: 103583|app: 0|req: 38/74] 10.222.0.77 () {60 vars in 1193 bytes} [Wed Aug 3 19:01:08 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:01:09.543000 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: DEBUG nova.api.openstack.wsgi [None req-5724266f-8aff-4861-a2c0-66349188378a admin admin] Calling method '>' {{(pid=103584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:09.544001 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: INFO nova.api.openstack.requestlog [None req-5724266f-8aff-4861-a2c0-66349188378a admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 03 19:01:09.544578 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: [pid: 103584|app: 0|req: 37/75] 10.222.0.77 () {56 vars in 1074 bytes} [Wed Aug 3 19:01:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:01:09.738462 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG nova.api.openstack.wsgi [None req-c6bd607b-abf0-4f31-94e1-623f7fdd5f45 admin admin] Calling method '>' {{(pid=103583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:09.740847 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 19:01:09.740847 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: warnings.warn(msg) Aug 03 19:01:09.742060 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG oslo_concurrency.lockutils [None req-c6bd607b-abf0-4f31-94e1-623f7fdd5f45 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:09.742525 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG oslo_concurrency.lockutils [None req-c6bd607b-abf0-4f31-94e1-623f7fdd5f45 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:09.743423 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG oslo_concurrency.lockutils [None req-c6bd607b-abf0-4f31-94e1-623f7fdd5f45 admin admin] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:09.743834 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: DEBUG oslo_concurrency.lockutils [None req-c6bd607b-abf0-4f31-94e1-623f7fdd5f45 admin admin] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:09.765534 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: INFO nova.api.openstack.requestlog [None req-c6bd607b-abf0-4f31-94e1-623f7fdd5f45 admin admin] 10.222.0.77 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079948 Aug 03 19:01:09.766077 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: [pid: 103583|app: 0|req: 39/76] 10.222.0.77 () {60 vars in 1193 bytes} [Wed Aug 3 19:01:09 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:02:08.920088 dv-cinder-852024-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 03 19:02:08.920632 dv-cinder-852024-1-iscsi devstack@n-api.service[103582]: Wed Aug 3 19:02:08 2022 - graceful shutdown triggered... Aug 03 19:02:08.921064 dv-cinder-852024-1-iscsi devstack@n-api.service[103584]: Gracefully killing worker 2 (pid: 103584)... Aug 03 19:02:08.921465 dv-cinder-852024-1-iscsi devstack@n-api.service[103583]: Gracefully killing worker 1 (pid: 103583)... Aug 03 19:02:09.921801 dv-cinder-852024-1-iscsi devstack@n-api.service[103582]: worker 1 buried after 1 seconds Aug 03 19:02:09.921801 dv-cinder-852024-1-iscsi devstack@n-api.service[103582]: worker 2 buried after 1 seconds Aug 03 19:02:09.922496 dv-cinder-852024-1-iscsi devstack@n-api.service[103582]: goodbye to uWSGI. Aug 03 19:02:09.923358 dv-cinder-852024-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 03 19:02:09.923983 dv-cinder-852024-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 03 19:02:09.926757 dv-cinder-852024-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 03 19:02:09.938299 dv-cinder-852024-1-iscsi devstack@n-api.service[118286]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 03 19:02:09.941049 dv-cinder-852024-1-iscsi devstack@n-api.service[118286]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 3 19:02:09 2022] *** Aug 03 19:02:09.941049 dv-cinder-852024-1-iscsi devstack@n-api.service[118286]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 03 19:02:09.941049 dv-cinder-852024-1-iscsi devstack@n-api.service[118286]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 03 19:02:09.941049 dv-cinder-852024-1-iscsi devstack@n-api.service[118286]: nodename: dv-cinder-852024-1-iscsi Aug 03 19:02:09.941049 dv-cinder-852024-1-iscsi devstack@n-api.service[118286]: machine: x86_64 Aug 03 19:02:09.941049 dv-cinder-852024-1-iscsi devstack@n-api.service[118286]: clock source: unix Aug 03 19:02:09.941049 dv-cinder-852024-1-iscsi devstack@n-api.service[118286]: pcre jit disabled Aug 03 19:02:09.941049 dv-cinder-852024-1-iscsi devstack@n-api.service[118286]: detected number of CPU cores: 4 Aug 03 19:02:09.941049 dv-cinder-852024-1-iscsi devstack@n-api.service[118286]: current working directory: / Aug 03 19:02:09.941049 dv-cinder-852024-1-iscsi devstack@n-api.service[118286]: detected binary path: /usr/bin/uwsgi-core Aug 03 19:02:09.941049 dv-cinder-852024-1-iscsi devstack@n-api.service[118286]: your processes number limit is 47680 Aug 03 19:02:09.941049 dv-cinder-852024-1-iscsi devstack@n-api.service[118286]: your memory page size is 4096 bytes Aug 03 19:02:09.941907 dv-cinder-852024-1-iscsi devstack@n-api.service[118286]: detected max file descriptor number: 2048 Aug 03 19:02:09.941907 dv-cinder-852024-1-iscsi devstack@n-api.service[118286]: lock engine: pthread robust mutexes Aug 03 19:02:09.941907 dv-cinder-852024-1-iscsi devstack@n-api.service[118286]: thunder lock: enabled Aug 03 19:02:09.941907 dv-cinder-852024-1-iscsi devstack@n-api.service[118286]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 03 19:02:09.941907 dv-cinder-852024-1-iscsi devstack@n-api.service[118286]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 03 19:02:09.981095 dv-cinder-852024-1-iscsi devstack@n-api.service[118286]: Python main interpreter initialized at 0x55ddef7fe9c0 Aug 03 19:02:09.981095 dv-cinder-852024-1-iscsi devstack@n-api.service[118286]: python threads support enabled Aug 03 19:02:09.981095 dv-cinder-852024-1-iscsi devstack@n-api.service[118286]: your server socket listen backlog is limited to 100 connections Aug 03 19:02:09.981095 dv-cinder-852024-1-iscsi devstack@n-api.service[118286]: your mercy for graceful operations on workers is 90 seconds Aug 03 19:02:09.981536 dv-cinder-852024-1-iscsi devstack@n-api.service[118286]: mapped 403077 bytes (393 KB) for 2 cores Aug 03 19:02:09.981638 dv-cinder-852024-1-iscsi devstack@n-api.service[118286]: *** Operational MODE: preforking *** Aug 03 19:02:09.981943 dv-cinder-852024-1-iscsi devstack@n-api.service[118286]: *** uWSGI is running in multiple interpreter mode *** Aug 03 19:02:09.981943 dv-cinder-852024-1-iscsi devstack@n-api.service[118286]: spawned uWSGI master process (pid: 118286) Aug 03 19:02:09.982065 dv-cinder-852024-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 03 19:02:09.986347 dv-cinder-852024-1-iscsi devstack@n-api.service[118286]: spawned uWSGI worker 1 (pid: 118302, cores: 1) Aug 03 19:02:09.986347 dv-cinder-852024-1-iscsi devstack@n-api.service[118286]: spawned uWSGI worker 2 (pid: 118303, cores: 1) Aug 03 19:02:09.986347 dv-cinder-852024-1-iscsi devstack@n-api.service[118286]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 03 19:02:10.665733 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 03 19:02:10.676296 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 03 19:02:11.823838 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 19:02:11.823838 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: from cryptography.utils import int_from_bytes Aug 03 19:02:11.824462 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 19:02:11.824462 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: from cryptography.utils import int_from_bytes Aug 03 19:02:11.842974 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 19:02:11.842974 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: from cryptography.utils import int_from_bytes Aug 03 19:02:11.843533 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 19:02:11.843533 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: from cryptography.utils import int_from_bytes Aug 03 19:02:14.233220 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 19:02:14.233810 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 19:02:14.234101 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 19:02:14.234306 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 19:02:14.234570 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 19:02:14.234994 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.235479 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.235649 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.235985 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.236328 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.236646 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.236981 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.237307 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.241126 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.241126 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.241126 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.241126 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852024-1-iscsi {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.241126 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.241126 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.241126 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.241126 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.241770 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.241770 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.241770 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.241770 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.242052 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.242125 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.243892 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.243892 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.243892 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.243892 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.243892 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.246807 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.246807 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.246807 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.246807 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852024-1-iscsi {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.246807 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.246807 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.246807 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.246807 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.247376 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.247376 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.247376 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.247690 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.248200 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.248711 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.249195 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.249678 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.250162 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.250654 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.251206 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.251715 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.252236 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.252725 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.253222 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.253671 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.254169 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.254685 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.255247 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.255768 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.256223 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.256686 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.257212 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.257737 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.258248 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.258746 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.259293 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.260454 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.261751 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.262287 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.262808 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.263345 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.263877 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.264394 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.264949 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.265461 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.266001 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.266616 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.77 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.267102 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.77 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.267636 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.268195 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.268682 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.269176 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.269513 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.270018 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.270346 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.270667 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.271175 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.271515 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.271869 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.272191 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.272453 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.272767 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.273084 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.273414 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.274346 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.274346 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.274346 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.274610 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.274933 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.280955 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.280955 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.280955 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.280955 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.280955 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.280955 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.280955 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.280955 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.281511 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.281511 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.281511 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.281511 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.281511 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.281511 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.281511 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.281511 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.282029 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.282029 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.282029 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.282228 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 19:02:14.282228 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 19:02:14.282691 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.282691 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.282826 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 19:02:14.282912 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.283056 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 19:02:14.283138 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.283216 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 19:02:14.283305 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.283487 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.283615 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.283800 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.283907 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.284116 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.284221 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.284434 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.284547 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.284746 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.284850 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.285054 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.285163 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.285362 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.285468 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.285671 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.285830 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.285980 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.286158 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.286304 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.286480 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.286715 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.286873 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.287060 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.287218 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852024-1-iscsi {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.287369 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.287512 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.287660 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.287814 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.287957 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.288108 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.288258 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.288427 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.288581 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.288724 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.288873 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.289025 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.289169 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.289533 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.289704 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.289859 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.290031 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.290202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.290352 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.290505 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.290649 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.290872 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.291078 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.291234 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.291383 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.291527 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.291679 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.291905 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.292590 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.292792 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.292952 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.293095 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.293236 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.293391 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.293542 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.293684 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.293833 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.293986 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.294142 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852024-1-iscsi {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.294303 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.294446 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.294596 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.294737 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.294878 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.295060 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.295205 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.295374 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.295537 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.295682 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.295838 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.296006 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.296156 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.296339 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.296485 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.296669 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.296830 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.296983 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.297133 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.297306 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.297456 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.297640 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.297798 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.297970 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.298128 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.298289 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.298440 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.298757 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.298912 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.299378 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.299815 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.300722 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.300876 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.301031 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.301184 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.301334 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.301483 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.301652 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.301837 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.302193 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.302345 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.302345 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.302345 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.302345 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.302882 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.303065 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.303217 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.303360 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.303500 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.303641 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.303801 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.303801 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.304091 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.304233 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.304383 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.304532 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.304689 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.304839 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.304983 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.305131 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.305280 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.305439 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.305600 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.305743 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.305891 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.306038 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.306182 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.306332 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.306596 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.306761 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.306912 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.307181 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.307367 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.307532 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.307684 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.307838 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.308069 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.308244 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.308397 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.308644 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.308804 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.309003 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.309156 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.309156 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.309372 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.309495 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.310069 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.77 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.310191 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.310303 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.77 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.310420 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.310540 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.310651 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.310768 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.310886 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.311046 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.318267 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.318596 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.318856 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.319055 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.319198 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.319332 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.319495 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.319632 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.319755 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.319755 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.320207 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.320342 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.320470 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.320613 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.320750 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.320887 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.321024 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.321168 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.321311 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.321311 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.321560 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.321687 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.321822 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.321949 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.322086 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.322228 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.322453 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.322601 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.322740 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.322877 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.323032 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.323223 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.323557 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.324079 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.324223 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.324354 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.324490 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.324630 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.324761 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.324897 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.325036 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.325172 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.325303 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.325441 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.325583 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.325712 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.325841 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.325977 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.326115 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.326264 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.326409 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.326547 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.326685 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.326915 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.327237 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.327237 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.327486 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.327614 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.327744 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.327872 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.328009 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.328148 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.328278 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.328414 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.328553 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.328691 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.328821 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.328949 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.329085 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.329230 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.329361 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.329490 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.329626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.329809 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.329943 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.330097 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.330358 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.330493 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.330621 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.330748 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.330890 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.330890 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.331187 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.331321 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.331451 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.331587 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.331736 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.331867 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.331995 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.331995 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.332243 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.332385 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.332601 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.332742 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.332872 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.333001 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.333127 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.333263 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.333403 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.333541 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.333671 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.333807 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.333936 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.334072 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.334206 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.334317 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.334445 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.334574 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.334702 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.334840 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.335003 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.335135 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.335263 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.335393 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.335533 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.335721 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.335858 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.335977 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.336096 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.336234 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.336372 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 19:02:14.336511 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.336649 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.336804 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.337039 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.337191 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.337344 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.337500 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.337652 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.337804 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.337954 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.338100 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.338301 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.338460 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.338612 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.339313 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.340775 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.340946 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.341104 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.341251 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.341402 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.341546 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.341697 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.341841 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.341994 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.342139 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.342293 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.342445 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.342445 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.342851 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.343058 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.343216 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.343368 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.343519 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.343663 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.343815 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.343959 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.344109 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.344260 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.344414 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.344558 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.344709 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.344860 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.345013 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.345156 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.345305 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.345448 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.345637 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.345871 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.346096 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.346324 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.346571 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.346805 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.347082 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.347249 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.347395 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.347538 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.347688 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.347847 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.347992 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.348144 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.348296 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.348454 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.348605 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.348774 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.348925 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.349068 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.349212 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.349354 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.349354 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.349807 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.349955 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.350104 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.350564 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.350728 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.351092 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.351092 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.351092 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.351649 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.351808 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.351952 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.352109 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.352254 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.352416 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.352566 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.352717 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.352951 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.353112 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.353262 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.353414 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.353414 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.353697 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.353850 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.354003 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.354155 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.354299 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.355085 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.355712 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.355712 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.355712 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.355712 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.358753 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.358918 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.358918 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.359248 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.359392 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.359543 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.359688 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.359838 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.359988 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.360146 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.360146 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.360432 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.360609 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.360760 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.361077 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.361316 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.361472 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.361617 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.361760 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.361910 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.362060 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.362221 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.362371 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.362515 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.362665 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.362817 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.363007 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.363243 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.363399 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.363550 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.363693 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.363836 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.363988 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.364210 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.364373 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.364518 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.364661 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.364804 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.364956 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.365108 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.365270 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.365422 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.365422 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.365709 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.365867 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.366020 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.366170 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.366313 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.366461 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.366614 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.366757 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.366900 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.367075 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.367230 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.367375 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.367527 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.367678 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.367830 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.367974 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.368117 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.368258 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.368416 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.368568 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.368712 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.368712 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.369010 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.369161 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.369311 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.369454 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.369603 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.369790 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.369969 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.370607 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.370773 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.370927 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.371221 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.371385 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.371531 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.371693 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.371845 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.371998 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.372150 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.372307 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.372451 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.372594 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.372869 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.373026 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.373180 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.373421 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.374275 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.374439 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.374597 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.374748 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.374906 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.375074 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.375239 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.375440 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.375628 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.375838 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.375997 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.376149 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.376299 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.376450 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.376606 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.376757 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.376911 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.377062 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.377212 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.377364 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.377523 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.377682 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.377826 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.377975 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.378119 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.378261 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.378403 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.378566 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.378710 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.378860 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.379031 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.379181 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.379324 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.379476 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.379620 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.379769 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.379919 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.380069 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.380211 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.380362 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.380517 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.380660 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.380802 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.380951 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.381114 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.381387 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.381548 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.381694 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.381844 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.381995 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.382181 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.382336 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.382487 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.382643 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.382643 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.383029 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.383200 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.383351 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.383592 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.383749 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.383893 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.384043 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.384199 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.384342 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.384493 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.384654 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.384798 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.384798 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.385092 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.385408 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.385584 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.385834 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.386574 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.386765 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.387316 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.387449 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.387576 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.387708 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.387838 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.387980 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.388112 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.388241 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.388377 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.388506 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.388635 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.388772 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.388911 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.389051 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.389188 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.389373 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.389521 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.389662 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.389791 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.389928 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.390066 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.390234 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.390372 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.390549 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.390684 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.390796 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.390908 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.391068 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.391212 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.391358 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.391560 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.391770 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.391942 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.392065 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.392189 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.392364 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.392498 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.392610 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.392720 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.392839 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.392977 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.393115 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.393254 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.393391 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.393528 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.393940 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.394095 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.394235 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.394235 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.394514 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.394646 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.394766 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.394878 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.395056 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.395236 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.395371 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.395501 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.395639 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.395771 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.395908 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.396037 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.396174 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.396314 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.396444 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.396574 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.396711 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.396849 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.396979 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.396979 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.397240 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.397371 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.397500 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.397500 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.397750 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.397895 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.398033 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.398170 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.398300 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.398437 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.398567 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.398710 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.398841 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.398986 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.399116 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.399245 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.399374 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.399516 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.399647 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.399790 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.400726 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.400866 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.401080 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.401213 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.401998 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.402391 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.402564 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.402712 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.402868 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.403040 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.403190 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.403329 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.403464 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.403598 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.403759 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.403974 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.404114 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.404247 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.404386 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.404617 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.404749 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.404866 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.404979 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.405168 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.405300 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.405427 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.405549 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.405665 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.405787 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.405903 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.406035 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.406181 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.406323 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.406457 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.406596 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.406729 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.406870 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.407034 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.407170 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.407303 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.407444 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.407593 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.407729 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.407872 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.408013 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.408146 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.408146 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.408405 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.408547 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.408688 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.408830 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.408964 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.409096 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.409235 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.409378 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.409528 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.409666 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.409799 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.409932 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.410071 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.410218 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.410352 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.410493 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.410627 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.410767 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.410914 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.411079 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.411211 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.411354 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.411497 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.411631 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.411770 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.411927 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.412143 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.412291 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.412439 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.412574 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.412707 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.412838 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.412977 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.413112 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.413258 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.413400 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.413532 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.413672 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.413805 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.413962 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.414166 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.414318 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.414462 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.414604 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.414738 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.414879 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.415098 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.415243 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.415359 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.415471 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.415584 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.415766 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.415891 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.416014 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.416129 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.416243 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.416365 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.416524 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.416660 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.416660 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.416974 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.416974 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.417700 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.417816 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.417936 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.417936 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.418207 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.418332 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.418457 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.418572 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.418686 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.418806 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.418921 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.419112 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.419239 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.419365 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.419480 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.419594 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.419707 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.419833 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.419957 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.420078 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.420193 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.420305 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.420419 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.420563 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.420715 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.420850 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.420990 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.421131 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.421272 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.421420 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.421555 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.421688 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.421828 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.421970 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.422119 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.422339 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.422486 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.422621 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.422762 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.422895 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.423045 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.423182 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.423300 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.423412 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.423533 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.423655 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.423790 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.423907 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.424021 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.424160 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.424374 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.424519 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.424666 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.424807 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.424949 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.425084 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.425223 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.425357 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.425504 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.425641 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.425773 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.425905 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.426037 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.426184 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.426319 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.426466 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.426606 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.426747 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.426888 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.427151 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.427279 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.427392 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.427512 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.427627 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.427741 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.427863 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.427978 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.428090 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.428090 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.428312 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.428312 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.428312 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.428312 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.428888 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.429033 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.429166 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.429306 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.429306 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.429575 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.429709 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.429851 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.429992 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.430139 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.430282 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.430424 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.430565 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.430707 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.430840 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.431008 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.431152 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.431286 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.431418 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.431550 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.431690 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.431833 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.431976 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.432108 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.432252 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.432474 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.432474 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.432769 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.432917 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.433068 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.433231 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.433385 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.433529 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.433663 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.433796 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.433929 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.433929 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.434179 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.434341 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.434544 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.434696 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.434839 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.435002 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.435155 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.435308 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.435452 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.435594 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.435735 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.435870 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.436011 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.436155 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.436288 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.436421 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.436553 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.436693 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.436693 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.436963 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.437096 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.437236 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.437370 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.437501 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.437647 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.437789 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.437936 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.438084 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.438234 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.438376 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.438510 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.438644 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.438775 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.438907 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.439065 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.439200 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.439343 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.439484 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.439607 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.439722 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.439844 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.439984 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.440119 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.440258 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.440401 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.440523 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.440668 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.440810 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.440943 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.441084 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.441225 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.441369 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.441512 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.441645 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.441778 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.441910 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.442050 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.442197 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.442339 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.442488 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.442688 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.442832 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.442832 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.443150 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.443295 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.443429 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.443572 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.443706 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.443839 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.443980 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.444114 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.444255 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.444389 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.444537 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.444748 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.444887 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.445020 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.445162 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.445296 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.445437 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.445582 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.445717 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.445858 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.445992 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.446132 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.446274 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.446490 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.446636 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.446777 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.446918 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.447068 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.447215 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.447350 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.447483 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.447615 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.447749 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.447882 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.448029 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.448242 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.448387 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.448521 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.448654 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.448845 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.448995 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.449112 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.449234 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.449350 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.449463 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.449585 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.449701 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.449821 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.449951 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.450068 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.450181 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.450303 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.450489 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.450656 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.450826 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.451043 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.451209 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.451371 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.451527 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.451675 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.451829 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.451985 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.452147 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.452312 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.452468 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.452615 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.452856 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.453010 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.453179 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.453328 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.453475 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.453621 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.453775 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.453912 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.454056 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.454191 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.454323 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.454464 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.454607 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.454757 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.454989 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.455122 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.455255 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.455389 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.455524 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.455675 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.455811 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.455951 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.456093 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.456235 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.456369 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.456511 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.456645 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.456778 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.456910 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.457041 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.457041 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.457314 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.457449 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.457588 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.457588 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.457854 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.457987 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.458129 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.458264 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.458264 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.458264 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.458649 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.458795 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.458929 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.459097 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.459214 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.459214 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.459425 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.459548 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.459663 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.459784 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.459897 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.460018 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.460132 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.460132 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.460359 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.460480 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.460602 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.460716 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.460828 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.460954 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.461069 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.461191 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.461306 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.461427 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.461555 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.461670 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.461791 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.461913 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.462026 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.462153 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.462275 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.462398 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.462512 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.462632 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.462747 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.462879 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.463099 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.463222 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.463342 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.463467 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.463590 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.463706 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.464405 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.464599 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.464779 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.464944 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.465139 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.465289 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.465405 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.465519 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.465639 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.465765 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.465894 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.466018 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.466132 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.466252 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.466252 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.466474 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.466587 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.466708 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.466832 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.466994 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.467128 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.467245 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.467374 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.467501 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.467626 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.467739 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.467871 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.467985 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.468116 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.468231 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.468353 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.468477 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.468599 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.468715 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.468837 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.468962 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.469082 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.469203 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.469317 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.469440 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.469563 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.469695 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.469810 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.469935 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.470056 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.470169 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.470169 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.470394 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.470517 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.470638 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.470760 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.470888 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.471041 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.471157 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.471281 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.471281 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.471512 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.471706 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.471831 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.471953 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.472078 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.472192 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.472304 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.472429 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.472579 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.472702 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.472817 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.472929 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.473065 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.473277 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.473397 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.473510 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.473622 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.473754 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.473878 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.473993 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.474105 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.474232 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.474353 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.474466 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.474587 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.474712 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.474825 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.475001 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.475142 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.475353 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.475489 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.475605 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.475717 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.475842 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.475956 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.476082 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.476204 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.476329 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.476453 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.476567 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.476679 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.476800 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.476932 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.477055 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.477175 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.477175 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.477406 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.477406 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.477636 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.477750 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.477880 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.478002 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.478117 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.478243 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.478358 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.478489 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.478618 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.478751 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.478875 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.479138 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.479289 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.479289 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.480811 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.480984 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.481150 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.481301 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.481470 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.481628 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.481778 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.481925 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.482088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.482252 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.482401 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.482560 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.482716 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.482874 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.483047 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.483215 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.483528 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.483692 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.483841 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.484004 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.484154 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.484154 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.484437 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.484583 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.484739 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.484739 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.485036 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.485184 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.485369 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.485597 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.485764 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.485922 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.486071 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.486218 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.486374 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.486531 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.486690 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.486839 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.487029 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.487188 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.487349 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.487513 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.487672 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.487821 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.487969 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.488116 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.488263 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.488420 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.488569 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.488716 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.488863 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.489010 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.489157 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.489324 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.489481 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.489638 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.489786 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.489941 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.490096 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.490259 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.490415 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.490571 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.490728 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.490876 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.491213 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.491450 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.491613 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.491764 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.491912 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.492080 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.492268 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.492435 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.492585 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.492733 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.492733 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.493030 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.493193 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.493350 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.493596 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.493759 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.493917 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.494073 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.494231 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.494231 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.494521 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.494669 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.494816 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.495078 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.495239 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.495397 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.495574 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.495795 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.495952 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.496111 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.496261 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.496409 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.496563 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.496719 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.496867 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.497028 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.497177 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.497333 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.497490 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.497657 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.497813 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.497972 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.498122 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.498269 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.498430 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.498587 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.498746 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.498902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.499077 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.499226 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.499374 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.499520 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.499692 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.499851 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.499851 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.500131 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.500279 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.500434 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.500661 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.500812 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.500968 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.501123 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.501361 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.501538 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.501701 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.501857 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.502013 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.502168 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.502334 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.502500 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.502657 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.502805 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.502972 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.503138 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.503287 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.503445 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.503621 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.503860 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.504021 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.504177 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.504327 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.504485 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.504634 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.504788 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.504938 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.505093 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.505251 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.505401 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.505549 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.505715 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.505874 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.506023 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.506185 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.506342 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.506498 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.506646 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.506794 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.507011 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.507184 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.507342 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.507491 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.507638 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.507797 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.507956 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.508113 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.508262 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.508410 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.508564 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.508564 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.508872 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.509031 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.509187 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.509334 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.509481 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.509630 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.509802 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.509959 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.510115 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.510271 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.510419 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.510567 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.511289 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.511289 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 19:02:14.511738 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.511738 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.511738 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.511738 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.511738 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.511738 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.511738 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.511738 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.512860 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.512860 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.512860 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.512860 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.512860 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.512860 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.512860 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.512860 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.514064 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.514064 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.514064 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.514064 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.514064 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.514779 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.514779 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.514779 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.515259 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.515408 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.515673 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.516021 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.516314 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.516633 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.516951 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.517270 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.517589 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.517983 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.518379 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.518737 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.519102 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.519432 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.519760 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.520087 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.520409 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.520729 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.521050 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.521370 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.521698 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.522038 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.522383 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.522721 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.523190 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.523518 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.523847 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.524179 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.524501 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.524833 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.525165 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.525740 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.526069 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.526441 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.526782 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.527348 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.527776 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.528114 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.528435 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.528751 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.529066 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.529388 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.529718 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.530039 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.530353 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.530666 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.531017 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.531319 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.531632 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.531944 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.532257 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.532574 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.532887 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.533199 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.533510 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.533821 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.534770 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.534770 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.534770 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.535323 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.535480 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.535678 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.535987 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.536297 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.536638 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.536981 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.537321 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.537638 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.537961 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.538294 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.538617 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.538968 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.539377 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.539707 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.540032 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.540370 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.540690 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.541088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.541333 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.541650 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.542506 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.543084 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.543407 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.543792 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.544066 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.544403 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.544733 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.545064 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.545394 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.545715 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.546054 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.546375 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.546695 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.547258 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.547806 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.547806 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.548208 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.548358 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.548608 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.549016 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.549349 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.549792 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.550326 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.553561 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.553561 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.553561 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.553561 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.553561 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.553561 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.554510 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.554510 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.554510 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.555084 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 19:02:14.555084 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 19:02:14.570453 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO dbcounter [None req-3cf0f7ea-c3e4-4bcc-abc7-095c9f18901e None None] Registered counter for database nova_api Aug 03 19:02:14.593128 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_db.sqlalchemy.engines [None req-3cf0f7ea-c3e4-4bcc-abc7-095c9f18901e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118302) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 19:02:14.600118 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writer thread running {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 19:02:14.618690 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO dbcounter [None req-ad42f032-0e2b-4163-ad7c-748a4811e5b5 None None] Registered counter for database nova_api Aug 03 19:02:14.639951 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_db.sqlalchemy.engines [None req-ad42f032-0e2b-4163-ad7c-748a4811e5b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118303) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 19:02:14.646862 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writer thread running {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 19:02:14.657583 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.context [None req-3cf0f7ea-c3e4-4bcc-abc7-095c9f18901e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),68a582b5-bf89-4c4b-b661-ad002d2788a1(cell1) {{(pid=118302) load_cells /opt/stack/nova/nova/context.py:464}} Aug 03 19:02:14.661733 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3cf0f7ea-c3e4-4bcc-abc7-095c9f18901e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:02:14.663641 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3cf0f7ea-c3e4-4bcc-abc7-095c9f18901e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:02:14.664488 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3cf0f7ea-c3e4-4bcc-abc7-095c9f18901e None None] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:02:14.666486 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3cf0f7ea-c3e4-4bcc-abc7-095c9f18901e None None] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:02:14.668609 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO dbcounter [None req-3cf0f7ea-c3e4-4bcc-abc7-095c9f18901e None None] Registered counter for database nova_cell0 Aug 03 19:02:14.672858 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO dbcounter [None req-3cf0f7ea-c3e4-4bcc-abc7-095c9f18901e None None] Registered counter for database nova_cell1 Aug 03 19:02:14.680184 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_db.sqlalchemy.engines [None req-3cf0f7ea-c3e4-4bcc-abc7-095c9f18901e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118302) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 19:02:14.682851 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_db.sqlalchemy.engines [None req-3cf0f7ea-c3e4-4bcc-abc7-095c9f18901e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118302) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 19:02:14.686274 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writer thread running {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 19:02:14.704954 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.context [None req-ad42f032-0e2b-4163-ad7c-748a4811e5b5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),68a582b5-bf89-4c4b-b661-ad002d2788a1(cell1) {{(pid=118303) load_cells /opt/stack/nova/nova/context.py:464}} Aug 03 19:02:14.709118 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ad42f032-0e2b-4163-ad7c-748a4811e5b5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:02:14.710707 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ad42f032-0e2b-4163-ad7c-748a4811e5b5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:02:14.711548 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ad42f032-0e2b-4163-ad7c-748a4811e5b5 None None] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:02:14.713554 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ad42f032-0e2b-4163-ad7c-748a4811e5b5 None None] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:02:14.715740 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO dbcounter [None req-ad42f032-0e2b-4163-ad7c-748a4811e5b5 None None] Registered counter for database nova_cell0 Aug 03 19:02:14.719810 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO dbcounter [None req-ad42f032-0e2b-4163-ad7c-748a4811e5b5 None None] Registered counter for database nova_cell1 Aug 03 19:02:14.727408 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_db.sqlalchemy.engines [None req-ad42f032-0e2b-4163-ad7c-748a4811e5b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118303) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 19:02:14.730140 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_db.sqlalchemy.engines [None req-ad42f032-0e2b-4163-ad7c-748a4811e5b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118303) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 19:02:14.735445 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writer thread running {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 19:02:14.738076 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writer thread running {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 19:02:14.830821 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writer thread running {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 19:02:14.840095 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO dbcounter [None req-3cf0f7ea-c3e4-4bcc-abc7-095c9f18901e None None] Registered counter for database nova_cell0 Aug 03 19:02:14.846808 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_db.sqlalchemy.engines [None req-3cf0f7ea-c3e4-4bcc-abc7-095c9f18901e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118302) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 19:02:14.851226 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writer thread running {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 19:02:14.886892 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO dbcounter [None req-ad42f032-0e2b-4163-ad7c-748a4811e5b5 None None] Registered counter for database nova_cell0 Aug 03 19:02:14.893448 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_db.sqlalchemy.engines [None req-ad42f032-0e2b-4163-ad7c-748a4811e5b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118303) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 19:02:14.898017 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writer thread running {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 19:02:15.176750 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: WARNING keystonemiddleware.auth_token [None req-3cf0f7ea-c3e4-4bcc-abc7-095c9f18901e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 19:02:15.185137 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: WARNING keystonemiddleware.auth_token [None req-3cf0f7ea-c3e4-4bcc-abc7-095c9f18901e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 19:02:15.226603 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: WARNING keystonemiddleware.auth_token [None req-ad42f032-0e2b-4163-ad7c-748a4811e5b5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 19:02:15.234825 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: WARNING keystonemiddleware.auth_token [None req-ad42f032-0e2b-4163-ad7c-748a4811e5b5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 19:02:15.539386 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: WARNING keystonemiddleware.auth_token [None req-3cf0f7ea-c3e4-4bcc-abc7-095c9f18901e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 19:02:15.546406 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: WARNING keystonemiddleware.auth_token [None req-3cf0f7ea-c3e4-4bcc-abc7-095c9f18901e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 19:02:15.551877 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ddef7fe9c0 pid: 118302 (default app) Aug 03 19:02:15.594212 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: WARNING keystonemiddleware.auth_token [None req-ad42f032-0e2b-4163-ad7c-748a4811e5b5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 19:02:15.600397 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: WARNING keystonemiddleware.auth_token [None req-ad42f032-0e2b-4163-ad7c-748a4811e5b5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 19:02:15.606443 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ddef7fe9c0 pid: 118303 (default app) Aug 03 19:02:53.037197 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_api:SELECT=3 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:02:53.038715 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=3 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:02:53.039685 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell0:SELECT=3 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:02:53.040332 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell0:SELECT=3 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:02:54.383285 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-f2de566c-8fd4-4805-a683-ac04968c8d42 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] Action: 'create', calling method: .version_select at 0x7f478835e940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-34100159"}} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:02:55.492218 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-5809d7cf-53ba-4af6-a54d-4c05a3930cf6 tempest-VolumesTestJSON-821243924 tempest-VolumesTestJSON-821243924-project] Calling method '.version_select at 0x7f478839b040>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:02:55.558411 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_api:SELECT=3 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:02:55.558411 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=3 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:02:55.560064 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell0:SELECT=3 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:02:55.561005 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell0:SELECT=3 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:02:56.227033 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-f2de566c-8fd4-4805-a683-ac04968c8d42 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] 10.222.0.77 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 3.210749 Aug 03 19:02:56.262206 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 1/1] 10.222.0.77 () {60 vars in 1155 bytes} [Wed Aug 3 19:02:53 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 3245 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 03 19:02:56.286526 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-d53b4bdf-c725-4725-9350-0de6cb1d1ab1 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] Calling method '.version_select at 0x7f478813fe50>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:02:56.812480 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-d53b4bdf-c725-4725-9350-0de6cb1d1ab1 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/1b051314-ed58-4a6f-afd7-cd8012b50936" status: 200 len: 343 microversion: 2.1 time: 0.547555 Aug 03 19:02:56.812480 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 2/2] 10.222.0.77 () {58 vars in 1245 bytes} [Wed Aug 3 19:02:56 2022] GET /compute/v2.1/os-volumes/1b051314-ed58-4a6f-afd7-cd8012b50936 => generated 343 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:02:57.285061 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-5809d7cf-53ba-4af6-a54d-4c05a3930cf6 tempest-VolumesTestJSON-821243924 tempest-VolumesTestJSON-821243924-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/3bba90c3-d62e-44a0-8f13-87f71452c9c2" status: 200 len: 351 microversion: 2.1 time: 2.229921 Aug 03 19:02:57.285728 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 1/3] 10.222.0.77 () {58 vars in 1245 bytes} [Wed Aug 3 19:02:55 2022] GET /compute/v2.1/os-volumes/3bba90c3-d62e-44a0-8f13-87f71452c9c2 => generated 351 bytes in 2232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 19:02:58.095791 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-773aec11-3ad1-41b3-82b4-58f1a6e6efa8 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] Calling method '.version_select at 0x7f4788155550>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:02:59.377076 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-773aec11-3ad1-41b3-82b4-58f1a6e6efa8 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/1b051314-ed58-4a6f-afd7-cd8012b50936" status: 200 len: 344 microversion: 2.1 time: 1.554945 Aug 03 19:02:59.377969 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 3/4] 10.222.0.77 () {58 vars in 1245 bytes} [Wed Aug 3 19:02:57 2022] GET /compute/v2.1/os-volumes/1b051314-ed58-4a6f-afd7-cd8012b50936 => generated 344 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:02:59.395507 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-81362281-059a-465f-8cdb-8fafe501fe96 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] Action: 'create', calling method: .version_select at 0x7f47881f4d30>, body: {"snapshot": {"volume_id": "1b051314-ed58-4a6f-afd7-cd8012b50936", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1900096055"}} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:03:00.249899 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-81362281-059a-465f-8cdb-8fafe501fe96 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] 10.222.0.77 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.859132 Aug 03 19:03:00.251213 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 2/5] 10.222.0.77 () {60 vars in 1162 bytes} [Wed Aug 3 19:02:59 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:03:00.264024 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-366aaedb-0144-4222-97e5-37f1627b63b3 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] Calling method '.version_select at 0x7f4788155c10>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:00.329185 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-366aaedb-0144-4222-97e5-37f1627b63b3 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/cc6e2584-673e-4835-8668-21d358f8d337" status: 200 len: 287 microversion: 2.1 time: 0.070548 Aug 03 19:03:00.330530 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 4/6] 10.222.0.77 () {58 vars in 1251 bytes} [Wed Aug 3 19:03:00 2022] GET /compute/v2.1/os-snapshots/cc6e2584-673e-4835-8668-21d358f8d337 => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:03:00.344338 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-f6faa148-a039-4ab4-b3ba-a787c787ef49 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] Calling method '.version_select at 0x7f47881b2af0>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:00.459037 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-f6faa148-a039-4ab4-b3ba-a787c787ef49 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.120848 Aug 03 19:03:00.461314 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 3/7] 10.222.0.77 () {58 vars in 1140 bytes} [Wed Aug 3 19:03:00 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:03:00.484162 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-6c9c421f-aff7-4163-a065-2ad313552b95 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] Calling method '.version_select at 0x7f4788155af0>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:00.610330 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-4639a10e-fad8-42cb-9bb9-a13c7fdf20ea tempest-VolumesTestJSON-821243924 tempest-VolumesTestJSON-821243924-project] Calling method '.version_select at 0x7f47881b2b80>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:00.635154 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-6c9c421f-aff7-4163-a065-2ad313552b95 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/cc6e2584-673e-4835-8668-21d358f8d337" status: 200 len: 287 microversion: 2.1 time: 0.156620 Aug 03 19:03:00.636973 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 5/8] 10.222.0.77 () {58 vars in 1251 bytes} [Wed Aug 3 19:03:00 2022] GET /compute/v2.1/os-snapshots/cc6e2584-673e-4835-8668-21d358f8d337 => generated 287 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:03:00.801724 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-4639a10e-fad8-42cb-9bb9-a13c7fdf20ea tempest-VolumesTestJSON-821243924 tempest-VolumesTestJSON-821243924-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/fbd611b2-4ce7-4cbd-a76e-923fb5cf7b3e" status: 200 len: 350 microversion: 2.1 time: 0.184952 Aug 03 19:03:00.801724 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 4/9] 10.222.0.77 () {58 vars in 1245 bytes} [Wed Aug 3 19:03:00 2022] GET /compute/v2.1/os-volumes/fbd611b2-4ce7-4cbd-a76e-923fb5cf7b3e => generated 350 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:03:01.678797 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-a2a12fa0-5cab-483d-b1e4-febafa7ed67c tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] Calling method '.version_select at 0x7f4788155430>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:02.104917 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-a2a12fa0-5cab-483d-b1e4-febafa7ed67c tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/cc6e2584-673e-4835-8668-21d358f8d337" status: 200 len: 287 microversion: 2.1 time: 0.455073 Aug 03 19:03:02.105985 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 6/10] 10.222.0.77 () {58 vars in 1251 bytes} [Wed Aug 3 19:03:01 2022] GET /compute/v2.1/os-snapshots/cc6e2584-673e-4835-8668-21d358f8d337 => generated 287 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:03:03.117919 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-99e3f1ca-880b-4129-b2ef-da8ba964c3b4 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] Calling method '.version_select at 0x7f478814f8b0>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:03.183992 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-99e3f1ca-880b-4129-b2ef-da8ba964c3b4 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/cc6e2584-673e-4835-8668-21d358f8d337" status: 200 len: 287 microversion: 2.1 time: 0.070060 Aug 03 19:03:03.184563 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 5/11] 10.222.0.77 () {58 vars in 1251 bytes} [Wed Aug 3 19:03:03 2022] GET /compute/v2.1/os-snapshots/cc6e2584-673e-4835-8668-21d358f8d337 => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:03:04.211210 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-82f8368e-068a-40f8-b7c5-8e6d14ffb0f4 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] Calling method '.version_select at 0x7f478813fe50>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:04.303268 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-82f8368e-068a-40f8-b7c5-8e6d14ffb0f4 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/cc6e2584-673e-4835-8668-21d358f8d337" status: 200 len: 287 microversion: 2.1 time: 0.110056 Aug 03 19:03:04.303842 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 7/12] 10.222.0.77 () {58 vars in 1251 bytes} [Wed Aug 3 19:03:04 2022] GET /compute/v2.1/os-snapshots/cc6e2584-673e-4835-8668-21d358f8d337 => generated 287 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:03:05.317555 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-7efaee1c-9a45-416b-843d-1ceffe563b90 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] Calling method '.version_select at 0x7f478814f160>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:05.391615 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-7efaee1c-9a45-416b-843d-1ceffe563b90 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/cc6e2584-673e-4835-8668-21d358f8d337" status: 200 len: 287 microversion: 2.1 time: 0.078689 Aug 03 19:03:05.392519 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 6/13] 10.222.0.77 () {58 vars in 1251 bytes} [Wed Aug 3 19:03:05 2022] GET /compute/v2.1/os-snapshots/cc6e2584-673e-4835-8668-21d358f8d337 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:03:05.957508 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-c3d34f82-7695-4477-8a07-e4ab41fe3abe tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-747045339", "imageRef": "0b6be242-215e-4886-a0d2-b8d5f8ca623e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:03:06.130119 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.network.neutron [None req-c3d34f82-7695-4477-8a07-e4ab41fe3abe tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] validate_networks() for [('3232e63b-0955-4dda-9cee-e40cb1ce02fa', None, None, None, None, None)] {{(pid=118302) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 19:03:06.321848 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-3b7af6d4-09f3-4f30-91e3-c682ae5bd44e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Action: 'create', calling method: .version_select at 0x7f47881f4ca0>, body: {"keypair": {"name": "tempest-keypair-332503108", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsAPxsgARjIi1cP1/KLBuVQkTII5mW4IbIjpubi74v7sHr1rxXCp2c5ck5VbP9F9RTHEzZEZkvw0SvfTwQ+uKvECk/onhqfu0GTmyu6g5vw258v71Yee5nRMrHIeVqx+g=="}} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:03:06.421520 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.quota [None req-3b7af6d4-09f3-4f30-91e3-c682ae5bd44e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Getting quotas for project 7d6df5e1251345209a0de754a734e8ec. Resources: {'key_pairs'} {{(pid=118303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:03:06.431347 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.quota [None req-3b7af6d4-09f3-4f30-91e3-c682ae5bd44e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Getting quotas for user 4fb68ecd7a9240948d6b5983f280e649 and project 7d6df5e1251345209a0de754a734e8ec. Resources: {'key_pairs'} {{(pid=118303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:03:06.610836 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-3b7af6d4-09f3-4f30-91e3-c682ae5bd44e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.394686 Aug 03 19:03:06.611729 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 7/14] 10.222.0.77 () {60 vars in 1159 bytes} [Wed Aug 3 19:03:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:03:06.623056 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-5da0cd00-ab79-4f4b-859b-163de12c4b4b tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] Calling method '.version_select at 0x7f47878db280>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:06.668474 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-5da0cd00-ab79-4f4b-859b-163de12c4b4b tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/cc6e2584-673e-4835-8668-21d358f8d337" status: 200 len: 287 microversion: 2.1 time: 0.055323 Aug 03 19:03:06.671811 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 8/15] 10.222.0.77 () {58 vars in 1251 bytes} [Wed Aug 3 19:03:06 2022] GET /compute/v2.1/os-snapshots/cc6e2584-673e-4835-8668-21d358f8d337 => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:03:07.553978 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-c3d34f82-7695-4477-8a07-e4ab41fe3abe tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Flavor limits 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 19:03:07.554480 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-c3d34f82-7695-4477-8a07-e4ab41fe3abe tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Image limits 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 19:03:07.554975 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-c3d34f82-7695-4477-8a07-e4ab41fe3abe tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Flavor pref 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 19:03:07.556766 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-c3d34f82-7695-4477-8a07-e4ab41fe3abe tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Image pref 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 19:03:07.558828 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-c3d34f82-7695-4477-8a07-e4ab41fe3abe tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 19:03:07.597721 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c3d34f82-7695-4477-8a07-e4ab41fe3abe tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:07.599315 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c3d34f82-7695-4477-8a07-e4ab41fe3abe tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:07.603882 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c3d34f82-7695-4477-8a07-e4ab41fe3abe tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:07.604655 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c3d34f82-7695-4477-8a07-e4ab41fe3abe tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:07.703711 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.quota [None req-c3d34f82-7695-4477-8a07-e4ab41fe3abe tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Getting quotas for project bf009469f935465baa6427ab4951944e. Resources: {'instances', 'cores', 'ram'} {{(pid=118302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:03:07.739391 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-afb66845-51f6-4b2b-9121-c863fd7b9003 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1466303874", "imageRef": "0b6be242-215e-4886-a0d2-b8d5f8ca623e", "flavorRef": "452", "networks": [{"uuid": "bae7fada-eb01-4b14-939a-16b282437d7d"}]}} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:03:07.741296 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.quota [None req-c3d34f82-7695-4477-8a07-e4ab41fe3abe tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Getting quotas for user 9c46900844e8483bb2dff3b9e65df372 and project bf009469f935465baa6427ab4951944e. Resources: {'instances', 'cores', 'ram'} {{(pid=118302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:03:07.815526 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-c3d34f82-7695-4477-8a07-e4ab41fe3abe tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Going to run 1 instances... {{(pid=118302) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 19:03:07.836471 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-c3d34f82-7695-4477-8a07-e4ab41fe3abe tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0b6be242-215e-4886-a0d2-b8d5f8ca623e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 19:03:07.929885 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.network.neutron [None req-afb66845-51f6-4b2b-9121-c863fd7b9003 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] validate_networks() for [('bae7fada-eb01-4b14-939a-16b282437d7d', None, None, None, None, None)] {{(pid=118303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 19:03:08.165870 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-c3d34f82-7695-4477-8a07-e4ab41fe3abe tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.400489 Aug 03 19:03:08.167861 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 8/16] 10.222.0.77 () {60 vars in 1147 bytes} [Wed Aug 3 19:03:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 2403 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 19:03:08.189015 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-c3f68b1b-fe96-464f-9e83-5a6cb0b7ced6 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] Calling method '.version_select at 0x7f478805c9d0>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:08.281421 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-c3f68b1b-fe96-464f-9e83-5a6cb0b7ced6 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/cc6e2584-673e-4835-8668-21d358f8d337" status: 200 len: 288 microversion: 2.1 time: 0.111683 Aug 03 19:03:08.281997 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 9/17] 10.222.0.77 () {58 vars in 1251 bytes} [Wed Aug 3 19:03:08 2022] GET /compute/v2.1/os-snapshots/cc6e2584-673e-4835-8668-21d358f8d337 => generated 288 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:03:08.290465 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-6a5fb4c3-06e9-40e9-ae63-5e82a0a25a8c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:08.291312 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-6a5fb4c3-06e9-40e9-ae63-5e82a0a25a8c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:08.526112 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-6a5fb4c3-06e9-40e9-ae63-5e82a0a25a8c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:08.584000 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-6a5fb4c3-06e9-40e9-ae63-5e82a0a25a8c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a" status: 200 len: 1221 microversion: 2.1 time: 0.300196 Aug 03 19:03:08.591047 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 10/18] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:08 2022] GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a => generated 1221 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:08.599816 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-3cc7137d-cb63-48e8-afb6-e696900abb2c tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] Calling method '.version_select at 0x7f4788076d30>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:08.980456 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-3cc7137d-cb63-48e8-afb6-e696900abb2c tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] 10.222.0.77 "DELETE /compute/v2.1/os-snapshots/cc6e2584-673e-4835-8668-21d358f8d337" status: 202 len: 0 microversion: 2.1 time: 0.387307 Aug 03 19:03:08.981073 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 11/19] 10.222.0.77 () {58 vars in 1254 bytes} [Wed Aug 3 19:03:08 2022] DELETE /compute/v2.1/os-snapshots/cc6e2584-673e-4835-8668-21d358f8d337 => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 19:03:08.994915 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-0d883110-ee0e-41ef-9448-dbffc489f0b3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1694642104", "imageRef": "0b6be242-215e-4886-a0d2-b8d5f8ca623e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:03:09.116944 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.network.neutron [None req-0d883110-ee0e-41ef-9448-dbffc489f0b3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] validate_networks() for [('3232e63b-0955-4dda-9cee-e40cb1ce02fa', None, None, None, None, None)] {{(pid=118302) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 19:03:09.844073 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-afb66845-51f6-4b2b-9121-c863fd7b9003 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Flavor limits 0:0:0 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 19:03:09.844690 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-afb66845-51f6-4b2b-9121-c863fd7b9003 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Image limits 0:0:0 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 19:03:09.845225 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-afb66845-51f6-4b2b-9121-c863fd7b9003 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Flavor pref 0:0:0 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 19:03:09.845753 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-afb66845-51f6-4b2b-9121-c863fd7b9003 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Image pref 0:0:0 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 19:03:09.846278 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-afb66845-51f6-4b2b-9121-c863fd7b9003 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 19:03:09.866416 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-afb66845-51f6-4b2b-9121-c863fd7b9003 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:09.868924 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-afb66845-51f6-4b2b-9121-c863fd7b9003 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:09.874162 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-afb66845-51f6-4b2b-9121-c863fd7b9003 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:09.878429 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-afb66845-51f6-4b2b-9121-c863fd7b9003 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:09.959802 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.quota [None req-afb66845-51f6-4b2b-9121-c863fd7b9003 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Getting quotas for project ee13f75b9c99495cb17bb8f88590a029. Resources: {'instances', 'cores', 'ram'} {{(pid=118303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:03:09.983365 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.quota [None req-afb66845-51f6-4b2b-9121-c863fd7b9003 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Getting quotas for user 52859bea3baf4e968e49df4e4d4aecf0 and project ee13f75b9c99495cb17bb8f88590a029. Resources: {'instances', 'cores', 'ram'} {{(pid=118303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:03:10.034379 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-afb66845-51f6-4b2b-9121-c863fd7b9003 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Going to run 1 instances... {{(pid=118303) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 19:03:10.040943 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-afb66845-51f6-4b2b-9121-c863fd7b9003 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0b6be242-215e-4886-a0d2-b8d5f8ca623e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 19:03:10.292242 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-afb66845-51f6-4b2b-9121-c863fd7b9003 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.639655 Aug 03 19:03:10.293403 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 9/20] 10.222.0.77 () {60 vars in 1147 bytes} [Wed Aug 3 19:03:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 19:03:10.306762 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-9e4a8c0b-0cc0-456c-b427-6fe138fe8a6b tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] Calling method '.version_select at 0x7f4787863f70>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:10.389677 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-9e4a8c0b-0cc0-456c-b427-6fe138fe8a6b tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/cc6e2584-673e-4835-8668-21d358f8d337" status: 200 len: 287 microversion: 2.1 time: 0.094956 Aug 03 19:03:10.395782 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 10/21] 10.222.0.77 () {58 vars in 1251 bytes} [Wed Aug 3 19:03:10 2022] GET /compute/v2.1/os-snapshots/cc6e2584-673e-4835-8668-21d358f8d337 => generated 287 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:03:10.403583 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-d40404cf-d64d-44eb-ac1f-1fe439ce7b69 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:10.404306 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-d40404cf-d64d-44eb-ac1f-1fe439ce7b69 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:10.580318 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-0d883110-ee0e-41ef-9448-dbffc489f0b3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Flavor limits 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 19:03:10.581259 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-0d883110-ee0e-41ef-9448-dbffc489f0b3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Image limits 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 19:03:10.581830 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-0d883110-ee0e-41ef-9448-dbffc489f0b3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Flavor pref 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 19:03:10.582403 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-0d883110-ee0e-41ef-9448-dbffc489f0b3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Image pref 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 19:03:10.582928 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-0d883110-ee0e-41ef-9448-dbffc489f0b3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 19:03:10.609286 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0d883110-ee0e-41ef-9448-dbffc489f0b3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:10.615002 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0d883110-ee0e-41ef-9448-dbffc489f0b3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:10.621880 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0d883110-ee0e-41ef-9448-dbffc489f0b3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:10.624463 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0d883110-ee0e-41ef-9448-dbffc489f0b3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:10.678378 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-d40404cf-d64d-44eb-ac1f-1fe439ce7b69 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:10.690559 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.quota [None req-0d883110-ee0e-41ef-9448-dbffc489f0b3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Getting quotas for project bf009469f935465baa6427ab4951944e. Resources: {'instances', 'cores', 'ram'} {{(pid=118302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:03:10.698656 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.quota [None req-0d883110-ee0e-41ef-9448-dbffc489f0b3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Getting quotas for user 9c46900844e8483bb2dff3b9e65df372 and project bf009469f935465baa6427ab4951944e. Resources: {'instances', 'cores', 'ram'} {{(pid=118302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:03:10.712670 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-d40404cf-d64d-44eb-ac1f-1fe439ce7b69 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1215 microversion: 2.1 time: 0.315335 Aug 03 19:03:10.713279 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 11/22] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:10 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1215 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:10.722429 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-0d883110-ee0e-41ef-9448-dbffc489f0b3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Going to run 1 instances... {{(pid=118302) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 19:03:10.725389 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-0d883110-ee0e-41ef-9448-dbffc489f0b3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0b6be242-215e-4886-a0d2-b8d5f8ca623e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 19:03:10.988599 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-0d883110-ee0e-41ef-9448-dbffc489f0b3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.001206 Aug 03 19:03:10.989845 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 12/23] 10.222.0.77 () {60 vars in 1147 bytes} [Wed Aug 3 19:03:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 2008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 19:03:11.016377 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-8cd5ef83-2aa6-4ba3-b7b1-13b6f97b6a34 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:11.017876 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-8cd5ef83-2aa6-4ba3-b7b1-13b6f97b6a34 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:11.131132 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-8cd5ef83-2aa6-4ba3-b7b1-13b6f97b6a34 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:11.140937 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-8cd5ef83-2aa6-4ba3-b7b1-13b6f97b6a34 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1222 microversion: 2.1 time: 0.140060 Aug 03 19:03:11.142038 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 12/24] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:10 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1222 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:11.405437 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-56b47fa4-6631-4e96-aa13-93a291903b11 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] Calling method '.version_select at 0x7f478700faf0>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:11.497488 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-56b47fa4-6631-4e96-aa13-93a291903b11 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/cc6e2584-673e-4835-8668-21d358f8d337" status: 200 len: 287 microversion: 2.1 time: 0.098668 Aug 03 19:03:11.504710 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 13/25] 10.222.0.77 () {58 vars in 1251 bytes} [Wed Aug 3 19:03:11 2022] GET /compute/v2.1/os-snapshots/cc6e2584-673e-4835-8668-21d358f8d337 => generated 287 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:03:11.743639 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-1d0b8aba-6cfb-4a44-847d-40e636543ad5 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:11.750134 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-1d0b8aba-6cfb-4a44-847d-40e636543ad5 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:11.755655 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-23672968-f5d7-4577-a619-0c362fa23fad tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1540599042", "imageRef": "0b6be242-215e-4886-a0d2-b8d5f8ca623e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5f6d75e2-e6cd-4ad1-b885-b8d0b189fc53"}], "security_groups": [{"name": "tempest-securitygroup--2113400941"}], "key_name": "tempest-keypair-332503108", "user_data": "}} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:03:11.918649 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-1d0b8aba-6cfb-4a44-847d-40e636543ad5 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:11.929742 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-1d0b8aba-6cfb-4a44-847d-40e636543ad5 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1215 microversion: 2.1 time: 0.196329 Aug 03 19:03:11.943137 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 13/26] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:11 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1215 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:12.031931 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.network.neutron [None req-23672968-f5d7-4577-a619-0c362fa23fad tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] validate_networks() for [('5f6d75e2-e6cd-4ad1-b885-b8d0b189fc53', None, None, None, None, None)] {{(pid=118302) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 19:03:12.171955 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-adcd240a-f4c0-4904-8717-245a46f514f8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:12.171955 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-adcd240a-f4c0-4904-8717-245a46f514f8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:12.395333 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-adcd240a-f4c0-4904-8717-245a46f514f8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:12.395333 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-adcd240a-f4c0-4904-8717-245a46f514f8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1222 microversion: 2.1 time: 0.220865 Aug 03 19:03:12.395333 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 14/27] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:12 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1222 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:12.541891 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-4dfb842f-3098-4f16-947e-f6c745ca2076 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] Calling method '.version_select at 0x7f4787833b80>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:12.606064 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.wsgi [None req-4dfb842f-3098-4f16-947e-f6c745ca2076 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] HTTP exception thrown: Snapshot cc6e2584-673e-4835-8668-21d358f8d337 could not be found. Aug 03 19:03:12.611354 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-4dfb842f-3098-4f16-947e-f6c745ca2076 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] Request method failure captured: Aug 03 19:03:12.611354 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: request: GET /compute/v2.1/os-snapshots/cc6e2584-673e-4835-8668-21d358f8d337 HTTP/1.1 Aug 03 19:03:12.611354 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept: application/json Aug 03 19:03:12.611354 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept-Encoding: identity Aug 03 19:03:12.611354 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Connection: close Aug 03 19:03:12.611354 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Length: 0 Aug 03 19:03:12.611354 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Type: application/json Aug 03 19:03:12.611354 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Host: 10.222.0.77 Aug 03 19:03:12.611354 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Openstack-System-Scope: None Aug 03 19:03:12.611354 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: User-Agent: python-urllib3/1.26.11 Aug 03 19:03:12.611354 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Auth-Token: gAAAAABi6sZca6Mq46BVfIhR5SZYl4-LZ9qv4iUewY0E7cXIqYSsqtZwc7EWmeVem7zBSU8clkyAXeBpulvW0Sxqaqyz0KCVyAk9j-ia7pTd1Ic9H0SZvg2SKqvRNQqwdJZBQhUBPgMDKRKD41zHx81A8nLb190UZAKAXhDkfDrJxuKgdT8z-ZA Aug 03 19:03:12.611354 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Id: None Aug 03 19:03:12.611354 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Name: None Aug 03 19:03:12.611354 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Identity-Status: Confirmed Aug 03 19:03:12.611354 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Is-Admin-Project: True Aug 03 19:03:12.611354 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Id: default Aug 03 19:03:12.611354 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Name: Default Aug 03 19:03:12.611354 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Id: c878afc5a62a412e927f5eeec8006717 Aug 03 19:03:12.611354 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-443355882 Aug 03 19:03:12.611354 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Role: reader,member Aug 03 19:03:12.611354 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Roles: reader,member Aug 03 19:03:12.612790 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_c878afc5a62a412e927f5eeec8006717", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/c878afc5a62a412e927f5eeec8006717"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/c878afc5a62a412e927f5eeec8006717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/c878afc5a62a412e927f5eeec8006717"}]}] Aug 03 19:03:12.612790 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant: tempest-VolumesSnapshotsTestJSON-443355882 Aug 03 19:03:12.612790 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Id: c878afc5a62a412e927f5eeec8006717 Aug 03 19:03:12.612790 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-443355882 Aug 03 19:03:12.612790 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User: tempest-VolumesSnapshotsTestJSON-443355882-project Aug 03 19:03:12.612790 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Id: default Aug 03 19:03:12.612790 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Name: Default Aug 03 19:03:12.612790 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Id: 09cf66e521414aa4842d1340e4c4a0d1 Aug 03 19:03:12.612790 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Name: tempest-VolumesSnapshotsTestJSON-443355882-project Aug 03 19:03:12.612790 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: method: Aug 03 19:03:12.612790 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: exception: Snapshot cc6e2584-673e-4835-8668-21d358f8d337 could not be found. Aug 03 19:03:12.612790 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: action_args: {'id': 'cc6e2584-673e-4835-8668-21d358f8d337'} Aug 03 19:03:12.612790 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:03:12.613619 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:03:12.613619 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 03 19:03:12.613619 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 03 19:03:12.613619 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 03 19:03:12.613619 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 03 19:03:12.613619 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 03 19:03:12.613619 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 03 19:03:12.613619 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 19:03:12.613619 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 19:03:12.613619 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 19:03:12.613619 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 19:03:12.613619 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 19:03:12.613619 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 19:03:12.613619 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 19:03:12.613619 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 19:03:12.613619 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot cc6e2584-673e-4835-8668-21d358f8d337 could not be found. (HTTP 404) (Request-ID: req-85c35811-1520-4859-8b8e-f14670697c6b) Aug 03 19:03:12.613619 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:03:12.613619 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:03:12.614752 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:03:12.614752 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:03:12.614752 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 03 19:03:12.614752 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 03 19:03:12.614752 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 19:03:12.614752 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 19:03:12.614752 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 03 19:03:12.614752 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 03 19:03:12.614752 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 19:03:12.614752 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 19:03:12.614752 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 03 19:03:12.614752 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 03 19:03:12.614752 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 03 19:03:12.614752 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 03 19:03:12.614752 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 03 19:03:12.614752 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 03 19:03:12.614752 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 19:03:12.614752 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 19:03:12.614752 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 19:03:12.616004 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 19:03:12.616004 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 19:03:12.616004 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 19:03:12.616004 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 19:03:12.616004 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 19:03:12.616004 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot cc6e2584-673e-4835-8668-21d358f8d337 could not be found. Aug 03 19:03:12.616004 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:03:12.616004 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:03:12.616004 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:03:12.616004 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:03:12.616004 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:03:12.616004 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:03:12.616004 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:03:12.616004 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:03:12.616004 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 19:03:12.616004 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 19:03:12.616004 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:03:12.616004 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:03:12.616004 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 03 19:03:12.616004 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:03:12.617253 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot cc6e2584-673e-4835-8668-21d358f8d337 could not be found. Aug 03 19:03:12.617253 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:03:12.617253 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:03:12.617253 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:03:12.617253 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:03:12.617253 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:03:12.617253 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:03:12.617253 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:03:12.617253 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:03:12.617253 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot cc6e2584-673e-4835-8668-21d358f8d337 could not be found. Aug 03 19:03:12.617253 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:03:12.617253 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-4dfb842f-3098-4f16-947e-f6c745ca2076 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] Returning 404 to user: Snapshot cc6e2584-673e-4835-8668-21d358f8d337 could not be found. {{(pid=118303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:03:12.618230 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-4dfb842f-3098-4f16-947e-f6c745ca2076 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/cc6e2584-673e-4835-8668-21d358f8d337" status: 404 len: 111 microversion: 2.1 time: 0.103111 Aug 03 19:03:12.624748 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 15/28] 10.222.0.77 () {58 vars in 1251 bytes} [Wed Aug 3 19:03:12 2022] GET /compute/v2.1/os-snapshots/cc6e2584-673e-4835-8668-21d358f8d337 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 19:03:12.631850 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-c6fbaae1-65eb-47c4-ad1c-45feb658e7e7 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] Calling method '.version_select at 0x7f4788abf310>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:13.014622 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-c6fbaae1-65eb-47c4-ad1c-45feb658e7e7 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] 10.222.0.77 "DELETE /compute/v2.1/os-volumes/1b051314-ed58-4a6f-afd7-cd8012b50936" status: 202 len: 0 microversion: 2.1 time: 0.387863 Aug 03 19:03:13.022313 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 16/29] 10.222.0.77 () {58 vars in 1248 bytes} [Wed Aug 3 19:03:12 2022] DELETE /compute/v2.1/os-volumes/1b051314-ed58-4a6f-afd7-cd8012b50936 => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 19:03:13.032889 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-0adcd085-f6f3-4e07-bb3d-7f41478baef9 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:13.034967 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-0adcd085-f6f3-4e07-bb3d-7f41478baef9 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:13.056408 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0adcd085-f6f3-4e07-bb3d-7f41478baef9 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:13.056886 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0adcd085-f6f3-4e07-bb3d-7f41478baef9 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:13.060085 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0adcd085-f6f3-4e07-bb3d-7f41478baef9 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:13.062179 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0adcd085-f6f3-4e07-bb3d-7f41478baef9 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:13.069998 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-23672968-f5d7-4577-a619-0c362fa23fad tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Flavor limits 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 19:03:13.071548 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-23672968-f5d7-4577-a619-0c362fa23fad tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Image limits 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 19:03:13.072650 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-23672968-f5d7-4577-a619-0c362fa23fad tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Flavor pref 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 19:03:13.076813 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-23672968-f5d7-4577-a619-0c362fa23fad tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Image pref 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 19:03:13.077534 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-23672968-f5d7-4577-a619-0c362fa23fad tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 19:03:13.107109 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-23672968-f5d7-4577-a619-0c362fa23fad tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:13.115191 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-23672968-f5d7-4577-a619-0c362fa23fad tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:13.118145 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-23672968-f5d7-4577-a619-0c362fa23fad tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:13.118818 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-23672968-f5d7-4577-a619-0c362fa23fad tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:13.173762 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.quota [None req-23672968-f5d7-4577-a619-0c362fa23fad tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Getting quotas for project 7d6df5e1251345209a0de754a734e8ec. Resources: {'instances', 'cores', 'ram'} {{(pid=118302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:03:13.181988 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.quota [None req-23672968-f5d7-4577-a619-0c362fa23fad tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Getting quotas for user 4fb68ecd7a9240948d6b5983f280e649 and project 7d6df5e1251345209a0de754a734e8ec. Resources: {'instances', 'cores', 'ram'} {{(pid=118302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:03:13.215316 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-23672968-f5d7-4577-a619-0c362fa23fad tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Going to run 1 instances... {{(pid=118302) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 19:03:13.234939 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-23672968-f5d7-4577-a619-0c362fa23fad tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0b6be242-215e-4886-a0d2-b8d5f8ca623e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 19:03:13.425461 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-0adcd085-f6f3-4e07-bb3d-7f41478baef9 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:13.451864 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-0adcd085-f6f3-4e07-bb3d-7f41478baef9 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1219 microversion: 2.1 time: 0.417565 Aug 03 19:03:13.452536 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 17/30] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:13 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1219 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:13.462534 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-81f4b775-205b-43c9-ab9f-635f15c05180 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] Calling method '.version_select at 0x7f47866fcb80>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:13.503586 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-23672968-f5d7-4577-a619-0c362fa23fad tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.752570 Aug 03 19:03:13.512910 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 14/31] 10.222.0.77 () {60 vars in 1147 bytes} [Wed Aug 3 19:03:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 1761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 19:03:13.517177 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-f0d77ec7-aa88-47ef-a6d0-f35fd379d375 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:13.517800 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-f0d77ec7-aa88-47ef-a6d0-f35fd379d375 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:13.531093 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f0d77ec7-aa88-47ef-a6d0-f35fd379d375 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:13.532064 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f0d77ec7-aa88-47ef-a6d0-f35fd379d375 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:13.533130 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f0d77ec7-aa88-47ef-a6d0-f35fd379d375 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:13.534739 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f0d77ec7-aa88-47ef-a6d0-f35fd379d375 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:13.726559 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-81f4b775-205b-43c9-ab9f-635f15c05180 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/1b051314-ed58-4a6f-afd7-cd8012b50936" status: 200 len: 343 microversion: 2.1 time: 0.272894 Aug 03 19:03:13.727655 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 18/32] 10.222.0.77 () {58 vars in 1245 bytes} [Wed Aug 3 19:03:13 2022] GET /compute/v2.1/os-volumes/1b051314-ed58-4a6f-afd7-cd8012b50936 => generated 343 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:03:13.741270 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-12e62022-177f-4448-b991-e3886f44dab5 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:13.741902 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-12e62022-177f-4448-b991-e3886f44dab5 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:13.833420 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-f0d77ec7-aa88-47ef-a6d0-f35fd379d375 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:13.866725 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-f0d77ec7-aa88-47ef-a6d0-f35fd379d375 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1218 microversion: 2.1 time: 0.353294 Aug 03 19:03:13.871273 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 15/33] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:13 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1218 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:13.913653 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-12e62022-177f-4448-b991-e3886f44dab5 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:13.923220 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-3e38af4c-de22-4bde-8e3c-4adc47bad9a8 tempest-VolumesTestJSON-821243924 tempest-VolumesTestJSON-821243924-project] Calling method '.version_select at 0x7f4788075790>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:13.937180 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-12e62022-177f-4448-b991-e3886f44dab5 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1237 microversion: 2.1 time: 0.203643 Aug 03 19:03:13.937649 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 19/34] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:13 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1237 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:14.054917 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-3e38af4c-de22-4bde-8e3c-4adc47bad9a8 tempest-VolumesTestJSON-821243924 tempest-VolumesTestJSON-821243924-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/4199cd56-0ecd-429e-b978-3965f6b97233" status: 200 len: 350 microversion: 2.1 time: 0.135727 Aug 03 19:03:14.055531 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 16/35] 10.222.0.77 () {58 vars in 1245 bytes} [Wed Aug 3 19:03:13 2022] GET /compute/v2.1/os-volumes/4199cd56-0ecd-429e-b978-3965f6b97233 => generated 350 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 19:03:14.071201 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-7560e7c4-c141-4182-a7c8-929edea85d5d tempest-VolumesTestJSON-821243924 tempest-VolumesTestJSON-821243924-project] Calling method '.version_select at 0x7f47867b61f0>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:14.483722 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-057777b7-b537-40b6-b8db-8e45e161b0cb tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:14.486280 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-057777b7-b537-40b6-b8db-8e45e161b0cb tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:14.501935 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-057777b7-b537-40b6-b8db-8e45e161b0cb tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:14.503865 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-057777b7-b537-40b6-b8db-8e45e161b0cb tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:14.505665 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-057777b7-b537-40b6-b8db-8e45e161b0cb tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:14.507087 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-057777b7-b537-40b6-b8db-8e45e161b0cb tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:14.584445 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-7560e7c4-c141-4182-a7c8-929edea85d5d tempest-VolumesTestJSON-821243924 tempest-VolumesTestJSON-821243924-project] 10.222.0.77 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.518404 Aug 03 19:03:14.586026 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 20/36] 10.222.0.77 () {58 vars in 1134 bytes} [Wed Aug 3 19:03:14 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:14.610307 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-68d4395f-e1bf-4d0b-8e5a-38292f5cd839 tempest-VolumesTestJSON-821243924 tempest-VolumesTestJSON-821243924-project] Calling method '.version_select at 0x7f4786721d30>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:14.643581 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-057777b7-b537-40b6-b8db-8e45e161b0cb tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:14.656242 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-057777b7-b537-40b6-b8db-8e45e161b0cb tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1267 microversion: 2.1 time: 0.181606 Aug 03 19:03:14.663928 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 17/37] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:14 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1267 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:14.744871 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-ec099218-3a09-48b5-931b-32f47957ffcb tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] Calling method '.version_select at 0x7f4786f5b670>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:14.759668 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-68d4395f-e1bf-4d0b-8e5a-38292f5cd839 tempest-VolumesTestJSON-821243924 tempest-VolumesTestJSON-821243924-project] 10.222.0.77 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.157409 Aug 03 19:03:14.761015 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 21/38] 10.222.0.77 () {58 vars in 1149 bytes} [Wed Aug 3 19:03:14 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:03:14.776961 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-0fca7ea2-0275-4ec7-add4-8c3f891e2c3b tempest-VolumesTestJSON-821243924 tempest-VolumesTestJSON-821243924-project] Calling method '.version_select at 0x7f4786721550>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:14.783570 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.wsgi [None req-ec099218-3a09-48b5-931b-32f47957ffcb tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] HTTP exception thrown: Volume 1b051314-ed58-4a6f-afd7-cd8012b50936 could not be found. Aug 03 19:03:14.788515 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-ec099218-3a09-48b5-931b-32f47957ffcb tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] Request method failure captured: Aug 03 19:03:14.788515 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: request: GET /compute/v2.1/os-volumes/1b051314-ed58-4a6f-afd7-cd8012b50936 HTTP/1.1 Aug 03 19:03:14.788515 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept: application/json Aug 03 19:03:14.788515 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept-Encoding: identity Aug 03 19:03:14.788515 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Connection: close Aug 03 19:03:14.788515 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Length: 0 Aug 03 19:03:14.788515 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Type: application/json Aug 03 19:03:14.788515 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Host: 10.222.0.77 Aug 03 19:03:14.788515 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Openstack-System-Scope: None Aug 03 19:03:14.788515 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: User-Agent: python-urllib3/1.26.11 Aug 03 19:03:14.788515 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Auth-Token: gAAAAABi6sZca6Mq46BVfIhR5SZYl4-LZ9qv4iUewY0E7cXIqYSsqtZwc7EWmeVem7zBSU8clkyAXeBpulvW0Sxqaqyz0KCVyAk9j-ia7pTd1Ic9H0SZvg2SKqvRNQqwdJZBQhUBPgMDKRKD41zHx81A8nLb190UZAKAXhDkfDrJxuKgdT8z-ZA Aug 03 19:03:14.788515 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Id: None Aug 03 19:03:14.788515 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Name: None Aug 03 19:03:14.788515 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Identity-Status: Confirmed Aug 03 19:03:14.788515 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Is-Admin-Project: True Aug 03 19:03:14.788515 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Id: default Aug 03 19:03:14.788515 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Name: Default Aug 03 19:03:14.788515 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Id: c878afc5a62a412e927f5eeec8006717 Aug 03 19:03:14.788515 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-443355882 Aug 03 19:03:14.788515 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Role: reader,member Aug 03 19:03:14.788515 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Roles: reader,member Aug 03 19:03:14.789896 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_c878afc5a62a412e927f5eeec8006717", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/c878afc5a62a412e927f5eeec8006717"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/c878afc5a62a412e927f5eeec8006717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/c878afc5a62a412e927f5eeec8006717"}]}] Aug 03 19:03:14.789896 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant: tempest-VolumesSnapshotsTestJSON-443355882 Aug 03 19:03:14.789896 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Id: c878afc5a62a412e927f5eeec8006717 Aug 03 19:03:14.789896 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-443355882 Aug 03 19:03:14.789896 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User: tempest-VolumesSnapshotsTestJSON-443355882-project Aug 03 19:03:14.789896 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Id: default Aug 03 19:03:14.789896 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Name: Default Aug 03 19:03:14.789896 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Id: 09cf66e521414aa4842d1340e4c4a0d1 Aug 03 19:03:14.789896 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Name: tempest-VolumesSnapshotsTestJSON-443355882-project Aug 03 19:03:14.789896 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: method: Aug 03 19:03:14.789896 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: exception: Volume 1b051314-ed58-4a6f-afd7-cd8012b50936 could not be found. Aug 03 19:03:14.789896 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: action_args: {'id': '1b051314-ed58-4a6f-afd7-cd8012b50936'} Aug 03 19:03:14.789896 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:03:14.790742 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:03:14.790742 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 19:03:14.790742 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 19:03:14.790742 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 19:03:14.790742 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 19:03:14.790742 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 19:03:14.790742 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 19:03:14.790742 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 19:03:14.790742 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 19:03:14.790742 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 19:03:14.790742 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 19:03:14.790742 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 19:03:14.790742 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 19:03:14.790742 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 19:03:14.790742 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 19:03:14.790742 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1b051314-ed58-4a6f-afd7-cd8012b50936 could not be found. (HTTP 404) (Request-ID: req-2bfdf34f-e52e-4510-a610-f0c920d084c7) Aug 03 19:03:14.790742 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:03:14.790742 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:03:14.790742 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:03:14.792394 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:03:14.792394 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 03 19:03:14.792394 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 03 19:03:14.792394 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 19:03:14.792394 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 19:03:14.792394 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 19:03:14.792394 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 19:03:14.792394 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 19:03:14.792394 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 19:03:14.792394 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 19:03:14.792394 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 19:03:14.792394 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 19:03:14.792394 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 19:03:14.792394 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 19:03:14.792394 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 19:03:14.792394 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 19:03:14.792394 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 19:03:14.792394 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 19:03:14.792394 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 19:03:14.793648 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 19:03:14.793648 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 19:03:14.793648 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 19:03:14.793648 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 19:03:14.793648 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1b051314-ed58-4a6f-afd7-cd8012b50936 could not be found. Aug 03 19:03:14.793648 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:03:14.793648 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:03:14.793648 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:03:14.793648 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:03:14.793648 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:03:14.793648 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:03:14.793648 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:03:14.793648 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:03:14.793648 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 19:03:14.793648 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 19:03:14.793648 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:03:14.793648 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:03:14.793648 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 03 19:03:14.793648 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:03:14.794799 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1b051314-ed58-4a6f-afd7-cd8012b50936 could not be found. Aug 03 19:03:14.794799 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:03:14.794799 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:03:14.794799 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:03:14.794799 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:03:14.794799 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:03:14.794799 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:03:14.794799 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:03:14.794799 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:03:14.794799 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1b051314-ed58-4a6f-afd7-cd8012b50936 could not be found. Aug 03 19:03:14.794799 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:03:14.794799 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-ec099218-3a09-48b5-931b-32f47957ffcb tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] Returning 404 to user: Volume 1b051314-ed58-4a6f-afd7-cd8012b50936 could not be found. {{(pid=118302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:03:14.794799 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-ec099218-3a09-48b5-931b-32f47957ffcb tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/1b051314-ed58-4a6f-afd7-cd8012b50936" status: 404 len: 109 microversion: 2.1 time: 0.051539 Aug 03 19:03:14.800232 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 18/39] 10.222.0.77 () {58 vars in 1245 bytes} [Wed Aug 3 19:03:14 2022] GET /compute/v2.1/os-volumes/1b051314-ed58-4a6f-afd7-cd8012b50936 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:03:14.806339 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-b35b98a7-8b45-4dc4-9352-dde27b17a653 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] Calling method '.version_select at 0x7f4786f5b550>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:14.894671 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-0fca7ea2-0275-4ec7-add4-8c3f891e2c3b tempest-VolumesTestJSON-821243924 tempest-VolumesTestJSON-821243924-project] 10.222.0.77 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.121109 Aug 03 19:03:14.896351 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 22/40] 10.222.0.77 () {58 vars in 1134 bytes} [Wed Aug 3 19:03:14 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:03:14.904415 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-b566129c-c857-4b25-bdb2-a8c11949792f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:14.905254 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-b566129c-c857-4b25-bdb2-a8c11949792f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:14.913126 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.wsgi [None req-b35b98a7-8b45-4dc4-9352-dde27b17a653 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] HTTP exception thrown: Volume 1b051314-ed58-4a6f-afd7-cd8012b50936 could not be found. Aug 03 19:03:14.915360 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b566129c-c857-4b25-bdb2-a8c11949792f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:14.915789 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b566129c-c857-4b25-bdb2-a8c11949792f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:14.916743 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b566129c-c857-4b25-bdb2-a8c11949792f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:14.917143 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-b35b98a7-8b45-4dc4-9352-dde27b17a653 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] Request method failure captured: Aug 03 19:03:14.917143 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: request: DELETE /compute/v2.1/os-volumes/1b051314-ed58-4a6f-afd7-cd8012b50936 HTTP/1.1 Aug 03 19:03:14.917143 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept: application/json Aug 03 19:03:14.917143 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept-Encoding: identity Aug 03 19:03:14.917143 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Connection: close Aug 03 19:03:14.917143 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Length: 0 Aug 03 19:03:14.917143 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Type: application/json Aug 03 19:03:14.917143 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Host: 10.222.0.77 Aug 03 19:03:14.917143 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Openstack-System-Scope: None Aug 03 19:03:14.917143 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: User-Agent: python-urllib3/1.26.11 Aug 03 19:03:14.917143 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Auth-Token: gAAAAABi6sZca6Mq46BVfIhR5SZYl4-LZ9qv4iUewY0E7cXIqYSsqtZwc7EWmeVem7zBSU8clkyAXeBpulvW0Sxqaqyz0KCVyAk9j-ia7pTd1Ic9H0SZvg2SKqvRNQqwdJZBQhUBPgMDKRKD41zHx81A8nLb190UZAKAXhDkfDrJxuKgdT8z-ZA Aug 03 19:03:14.917143 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Id: None Aug 03 19:03:14.917143 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Name: None Aug 03 19:03:14.917143 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Identity-Status: Confirmed Aug 03 19:03:14.917143 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Is-Admin-Project: True Aug 03 19:03:14.917143 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Id: default Aug 03 19:03:14.917143 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Name: Default Aug 03 19:03:14.917143 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Id: c878afc5a62a412e927f5eeec8006717 Aug 03 19:03:14.917143 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-443355882 Aug 03 19:03:14.917143 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Role: reader,member Aug 03 19:03:14.917143 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Roles: reader,member Aug 03 19:03:14.918331 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_c878afc5a62a412e927f5eeec8006717", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/c878afc5a62a412e927f5eeec8006717"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/c878afc5a62a412e927f5eeec8006717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/c878afc5a62a412e927f5eeec8006717"}]}] Aug 03 19:03:14.918331 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant: tempest-VolumesSnapshotsTestJSON-443355882 Aug 03 19:03:14.918331 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Id: c878afc5a62a412e927f5eeec8006717 Aug 03 19:03:14.918331 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-443355882 Aug 03 19:03:14.918331 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User: tempest-VolumesSnapshotsTestJSON-443355882-project Aug 03 19:03:14.918331 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Id: default Aug 03 19:03:14.918331 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Name: Default Aug 03 19:03:14.918331 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Id: 09cf66e521414aa4842d1340e4c4a0d1 Aug 03 19:03:14.918331 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Name: tempest-VolumesSnapshotsTestJSON-443355882-project Aug 03 19:03:14.918331 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: method: Aug 03 19:03:14.918331 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: exception: Volume 1b051314-ed58-4a6f-afd7-cd8012b50936 could not be found. Aug 03 19:03:14.918331 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: action_args: {'id': '1b051314-ed58-4a6f-afd7-cd8012b50936'} Aug 03 19:03:14.918331 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:03:14.919165 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:03:14.919165 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 19:03:14.919165 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 19:03:14.919165 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 19:03:14.919165 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 19:03:14.919165 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 19:03:14.919165 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 19:03:14.919165 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 19:03:14.919165 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 19:03:14.919165 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 19:03:14.919165 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 19:03:14.919165 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 19:03:14.919165 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 19:03:14.919165 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 19:03:14.919165 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 19:03:14.919165 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1b051314-ed58-4a6f-afd7-cd8012b50936 could not be found. (HTTP 404) (Request-ID: req-4f999ff9-619f-4483-8248-3b207a6d549c) Aug 03 19:03:14.919165 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:03:14.919165 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:03:14.919165 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:03:14.920266 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:03:14.920266 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 03 19:03:14.920266 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 03 19:03:14.920266 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 19:03:14.920266 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 19:03:14.920266 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 19:03:14.920266 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 19:03:14.920266 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 19:03:14.920266 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 19:03:14.920266 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 19:03:14.920266 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 19:03:14.920266 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 19:03:14.920266 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 19:03:14.920266 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 19:03:14.920266 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 19:03:14.920266 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 19:03:14.920266 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 19:03:14.920266 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 19:03:14.920266 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 19:03:14.921276 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 19:03:14.921276 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 19:03:14.921276 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 19:03:14.921276 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 19:03:14.921276 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1b051314-ed58-4a6f-afd7-cd8012b50936 could not be found. Aug 03 19:03:14.921276 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:03:14.921276 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:03:14.921276 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:03:14.921276 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:03:14.921276 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:03:14.921276 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:03:14.921276 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:03:14.921276 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:03:14.921276 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 19:03:14.921276 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 19:03:14.921276 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:03:14.921276 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:03:14.921276 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 03 19:03:14.921276 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:03:14.922306 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1b051314-ed58-4a6f-afd7-cd8012b50936 could not be found. Aug 03 19:03:14.922306 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:03:14.922306 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:03:14.922306 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:03:14.922306 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:03:14.922306 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:03:14.922306 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:03:14.922306 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:03:14.922306 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:03:14.922306 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1b051314-ed58-4a6f-afd7-cd8012b50936 could not be found. Aug 03 19:03:14.922306 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:03:14.922926 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b566129c-c857-4b25-bdb2-a8c11949792f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:14.924705 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-b35b98a7-8b45-4dc4-9352-dde27b17a653 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] Returning 404 to user: Volume 1b051314-ed58-4a6f-afd7-cd8012b50936 could not be found. {{(pid=118302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:03:14.927344 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-b35b98a7-8b45-4dc4-9352-dde27b17a653 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] 10.222.0.77 "DELETE /compute/v2.1/os-volumes/1b051314-ed58-4a6f-afd7-cd8012b50936" status: 404 len: 109 microversion: 2.1 time: 0.123382 Aug 03 19:03:14.930791 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 19/41] 10.222.0.77 () {58 vars in 1248 bytes} [Wed Aug 3 19:03:14 2022] DELETE /compute/v2.1/os-volumes/1b051314-ed58-4a6f-afd7-cd8012b50936 => generated 109 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:03:14.935377 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-ffc65f0f-6e0f-4298-b68f-c8d453306cf8 tempest-VolumesTestJSON-821243924 tempest-VolumesTestJSON-821243924-project] Calling method '.version_select at 0x7f4786ebc4c0>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:15.053347 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-b566129c-c857-4b25-bdb2-a8c11949792f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:15.064953 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-b566129c-c857-4b25-bdb2-a8c11949792f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1274 microversion: 2.1 time: 0.163625 Aug 03 19:03:15.070221 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 23/42] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:14 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1274 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:15.076075 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-c6ea3f0b-bd97-4b61-a320-e028c2ad7075 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] Calling method '.version_select at 0x7f47866fca60>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:15.133706 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.wsgi [None req-c6ea3f0b-bd97-4b61-a320-e028c2ad7075 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] HTTP exception thrown: Volume 1b051314-ed58-4a6f-afd7-cd8012b50936 could not be found. Aug 03 19:03:15.136991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-c6ea3f0b-bd97-4b61-a320-e028c2ad7075 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] Request method failure captured: Aug 03 19:03:15.136991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: request: GET /compute/v2.1/os-volumes/1b051314-ed58-4a6f-afd7-cd8012b50936 HTTP/1.1 Aug 03 19:03:15.136991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept: application/json Aug 03 19:03:15.136991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept-Encoding: identity Aug 03 19:03:15.136991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Connection: close Aug 03 19:03:15.136991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Length: 0 Aug 03 19:03:15.136991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Type: application/json Aug 03 19:03:15.136991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Host: 10.222.0.77 Aug 03 19:03:15.136991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Openstack-System-Scope: None Aug 03 19:03:15.136991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: User-Agent: python-urllib3/1.26.11 Aug 03 19:03:15.136991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Auth-Token: gAAAAABi6sZca6Mq46BVfIhR5SZYl4-LZ9qv4iUewY0E7cXIqYSsqtZwc7EWmeVem7zBSU8clkyAXeBpulvW0Sxqaqyz0KCVyAk9j-ia7pTd1Ic9H0SZvg2SKqvRNQqwdJZBQhUBPgMDKRKD41zHx81A8nLb190UZAKAXhDkfDrJxuKgdT8z-ZA Aug 03 19:03:15.136991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Id: None Aug 03 19:03:15.136991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Name: None Aug 03 19:03:15.136991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Identity-Status: Confirmed Aug 03 19:03:15.136991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Is-Admin-Project: True Aug 03 19:03:15.136991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Id: default Aug 03 19:03:15.136991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Name: Default Aug 03 19:03:15.136991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Id: c878afc5a62a412e927f5eeec8006717 Aug 03 19:03:15.136991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-443355882 Aug 03 19:03:15.136991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Role: reader,member Aug 03 19:03:15.136991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Roles: reader,member Aug 03 19:03:15.138269 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_c878afc5a62a412e927f5eeec8006717", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/c878afc5a62a412e927f5eeec8006717"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/c878afc5a62a412e927f5eeec8006717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/c878afc5a62a412e927f5eeec8006717"}]}] Aug 03 19:03:15.138269 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant: tempest-VolumesSnapshotsTestJSON-443355882 Aug 03 19:03:15.138269 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Id: c878afc5a62a412e927f5eeec8006717 Aug 03 19:03:15.138269 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-443355882 Aug 03 19:03:15.138269 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User: tempest-VolumesSnapshotsTestJSON-443355882-project Aug 03 19:03:15.138269 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Id: default Aug 03 19:03:15.138269 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Name: Default Aug 03 19:03:15.138269 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Id: 09cf66e521414aa4842d1340e4c4a0d1 Aug 03 19:03:15.138269 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Name: tempest-VolumesSnapshotsTestJSON-443355882-project Aug 03 19:03:15.138269 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: method: Aug 03 19:03:15.138269 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: exception: Volume 1b051314-ed58-4a6f-afd7-cd8012b50936 could not be found. Aug 03 19:03:15.138269 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: action_args: {'id': '1b051314-ed58-4a6f-afd7-cd8012b50936'} Aug 03 19:03:15.138269 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:03:15.139109 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:03:15.139109 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 19:03:15.139109 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 19:03:15.139109 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 19:03:15.139109 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 19:03:15.139109 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 19:03:15.139109 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 19:03:15.139109 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 19:03:15.139109 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 19:03:15.139109 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 19:03:15.139109 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 19:03:15.139109 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 19:03:15.139109 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 19:03:15.139109 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 19:03:15.139109 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 19:03:15.139109 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1b051314-ed58-4a6f-afd7-cd8012b50936 could not be found. (HTTP 404) (Request-ID: req-c013dee5-050d-4d4b-8789-8470abcd6839) Aug 03 19:03:15.139109 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:03:15.139109 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:03:15.139109 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:03:15.140260 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:03:15.140260 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 03 19:03:15.140260 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 03 19:03:15.140260 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 19:03:15.140260 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 19:03:15.140260 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 19:03:15.140260 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 19:03:15.140260 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 19:03:15.140260 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 19:03:15.140260 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 19:03:15.140260 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 19:03:15.140260 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 19:03:15.140260 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 19:03:15.140260 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 19:03:15.140260 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 19:03:15.140260 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 19:03:15.140260 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 19:03:15.140260 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 19:03:15.140260 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 19:03:15.141442 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 19:03:15.141442 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 19:03:15.141442 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 19:03:15.141442 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 19:03:15.141442 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1b051314-ed58-4a6f-afd7-cd8012b50936 could not be found. Aug 03 19:03:15.141442 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:03:15.141442 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:03:15.141442 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:03:15.141442 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:03:15.141442 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:03:15.141442 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:03:15.141442 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:03:15.141442 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:03:15.141442 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 19:03:15.141442 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 19:03:15.141442 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:03:15.141442 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:03:15.141442 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 03 19:03:15.141442 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:03:15.142731 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1b051314-ed58-4a6f-afd7-cd8012b50936 could not be found. Aug 03 19:03:15.142731 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:03:15.142731 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:03:15.142731 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:03:15.142731 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:03:15.142731 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:03:15.142731 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:03:15.142731 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:03:15.142731 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:03:15.142731 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1b051314-ed58-4a6f-afd7-cd8012b50936 could not be found. Aug 03 19:03:15.142731 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:03:15.144592 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-c6ea3f0b-bd97-4b61-a320-e028c2ad7075 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] Returning 404 to user: Volume 1b051314-ed58-4a6f-afd7-cd8012b50936 could not be found. {{(pid=118303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:03:15.145872 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-c6ea3f0b-bd97-4b61-a320-e028c2ad7075 tempest-VolumesSnapshotsTestJSON-443355882 tempest-VolumesSnapshotsTestJSON-443355882-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/1b051314-ed58-4a6f-afd7-cd8012b50936" status: 404 len: 109 microversion: 2.1 time: 0.074347 Aug 03 19:03:15.150196 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 24/43] 10.222.0.77 () {58 vars in 1245 bytes} [Wed Aug 3 19:03:15 2022] GET /compute/v2.1/os-volumes/1b051314-ed58-4a6f-afd7-cd8012b50936 => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:03:15.159099 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-ffc65f0f-6e0f-4298-b68f-c8d453306cf8 tempest-VolumesTestJSON-821243924 tempest-VolumesTestJSON-821243924-project] 10.222.0.77 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.229545 Aug 03 19:03:15.160016 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 20/44] 10.222.0.77 () {58 vars in 1167 bytes} [Wed Aug 3 19:03:14 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:03:15.160813 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-fcd3adb1-2ada-40e6-830d-440fd5d6053b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:15.161772 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-fcd3adb1-2ada-40e6-830d-440fd5d6053b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:15.169400 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fcd3adb1-2ada-40e6-830d-440fd5d6053b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:15.170139 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fcd3adb1-2ada-40e6-830d-440fd5d6053b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:15.171508 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fcd3adb1-2ada-40e6-830d-440fd5d6053b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:15.172173 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fcd3adb1-2ada-40e6-830d-440fd5d6053b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:15.179432 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-bf30252c-4153-4ef0-aa3d-6a4cab2796d8 tempest-VolumesTestJSON-821243924 tempest-VolumesTestJSON-821243924-project] Calling method '.version_select at 0x7f4786ebc940>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:15.294997 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-bf30252c-4153-4ef0-aa3d-6a4cab2796d8 tempest-VolumesTestJSON-821243924 tempest-VolumesTestJSON-821243924-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.124206 Aug 03 19:03:15.295713 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 21/45] 10.222.0.77 () {58 vars in 1170 bytes} [Wed Aug 3 19:03:15 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:03:15.310334 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-86ebe730-0df3-49b7-bda2-bfed0025cb40 tempest-VolumesTestJSON-821243924 tempest-VolumesTestJSON-821243924-project] Calling method '.version_select at 0x7f4786f5b1f0>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:15.314448 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-fcd3adb1-2ada-40e6-830d-440fd5d6053b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:15.325149 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-fcd3adb1-2ada-40e6-830d-440fd5d6053b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1241 microversion: 2.1 time: 0.172679 Aug 03 19:03:15.325683 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 25/46] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:15 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1241 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:15.439140 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-86ebe730-0df3-49b7-bda2-bfed0025cb40 tempest-VolumesTestJSON-821243924 tempest-VolumesTestJSON-821243924-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.133676 Aug 03 19:03:15.441174 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 22/47] 10.222.0.77 () {58 vars in 1155 bytes} [Wed Aug 3 19:03:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:03:15.483991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-dc884a69-2977-4302-9142-a469631812c8 tempest-VolumesTestJSON-821243924 tempest-VolumesTestJSON-821243924-project] Calling method '.version_select at 0x7f47866e2790>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:15.591403 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-dc884a69-2977-4302-9142-a469631812c8 tempest-VolumesTestJSON-821243924 tempest-VolumesTestJSON-821243924-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.141052 Aug 03 19:03:15.592190 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 26/48] 10.222.0.77 () {58 vars in 1188 bytes} [Wed Aug 3 19:03:15 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:03:15.605511 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-e0a079e1-b049-4aa1-a967-a9e01ee1434e tempest-VolumesTestJSON-821243924 tempest-VolumesTestJSON-821243924-project] Calling method '.version_select at 0x7f4786ed6a60>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:15.698548 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-818459d7-7489-403c-a90f-16da56ca3fd0 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:15.699558 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-818459d7-7489-403c-a90f-16da56ca3fd0 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:15.700160 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-e0a079e1-b049-4aa1-a967-a9e01ee1434e tempest-VolumesTestJSON-821243924 tempest-VolumesTestJSON-821243924-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.099077 Aug 03 19:03:15.700849 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 23/49] 10.222.0.77 () {58 vars in 1155 bytes} [Wed Aug 3 19:03:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:15.707883 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-818459d7-7489-403c-a90f-16da56ca3fd0 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:15.712032 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-818459d7-7489-403c-a90f-16da56ca3fd0 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:15.712032 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-818459d7-7489-403c-a90f-16da56ca3fd0 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:15.712032 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-818459d7-7489-403c-a90f-16da56ca3fd0 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:15.812934 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-818459d7-7489-403c-a90f-16da56ca3fd0 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:15.821734 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-818459d7-7489-403c-a90f-16da56ca3fd0 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1267 microversion: 2.1 time: 0.128492 Aug 03 19:03:15.822633 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 27/50] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:15 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1267 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:16.097004 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-b1f908b3-7b93-4e60-9a26-6c1c02b9d057 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:16.098020 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-b1f908b3-7b93-4e60-9a26-6c1c02b9d057 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:16.106321 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b1f908b3-7b93-4e60-9a26-6c1c02b9d057 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:16.106888 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b1f908b3-7b93-4e60-9a26-6c1c02b9d057 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:16.107749 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b1f908b3-7b93-4e60-9a26-6c1c02b9d057 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:16.108261 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b1f908b3-7b93-4e60-9a26-6c1c02b9d057 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:16.264519 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-b1f908b3-7b93-4e60-9a26-6c1c02b9d057 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:16.299727 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-b1f908b3-7b93-4e60-9a26-6c1c02b9d057 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1274 microversion: 2.1 time: 0.207987 Aug 03 19:03:16.300345 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 24/51] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:16 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1274 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:16.351283 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-6a8dff82-360a-4820-a7df-cf088b3dea01 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:16.357156 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-6a8dff82-360a-4820-a7df-cf088b3dea01 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:16.363847 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6a8dff82-360a-4820-a7df-cf088b3dea01 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:16.364668 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6a8dff82-360a-4820-a7df-cf088b3dea01 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:16.366050 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6a8dff82-360a-4820-a7df-cf088b3dea01 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:16.366996 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6a8dff82-360a-4820-a7df-cf088b3dea01 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:16.452139 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-6a8dff82-360a-4820-a7df-cf088b3dea01 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:16.457962 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-6a8dff82-360a-4820-a7df-cf088b3dea01 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1241 microversion: 2.1 time: 0.114630 Aug 03 19:03:16.458593 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 28/52] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:16 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1241 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:16.843556 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-d11000e3-4950-4ce8-bca6-d1a915817d18 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:16.844359 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-d11000e3-4950-4ce8-bca6-d1a915817d18 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:16.851469 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d11000e3-4950-4ce8-bca6-d1a915817d18 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:16.852299 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d11000e3-4950-4ce8-bca6-d1a915817d18 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:16.853280 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d11000e3-4950-4ce8-bca6-d1a915817d18 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:16.853988 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d11000e3-4950-4ce8-bca6-d1a915817d18 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:16.929978 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-d11000e3-4950-4ce8-bca6-d1a915817d18 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:16.943083 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-d11000e3-4950-4ce8-bca6-d1a915817d18 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1267 microversion: 2.1 time: 0.103100 Aug 03 19:03:16.945066 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 25/53] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:16 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1267 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:17.324006 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-b67102b6-7b31-4552-b2d8-11dafba9dbb0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:17.324006 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-b67102b6-7b31-4552-b2d8-11dafba9dbb0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:17.334486 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b67102b6-7b31-4552-b2d8-11dafba9dbb0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:17.335007 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b67102b6-7b31-4552-b2d8-11dafba9dbb0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:17.336458 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b67102b6-7b31-4552-b2d8-11dafba9dbb0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:17.337248 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b67102b6-7b31-4552-b2d8-11dafba9dbb0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:17.450369 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-b67102b6-7b31-4552-b2d8-11dafba9dbb0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:17.460525 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-b67102b6-7b31-4552-b2d8-11dafba9dbb0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1274 microversion: 2.1 time: 0.142089 Aug 03 19:03:17.462316 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 29/54] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:17 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1274 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:17.481607 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-df8713b2-6edd-4cca-9ccc-3d539d33f409 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:17.482792 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-df8713b2-6edd-4cca-9ccc-3d539d33f409 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:17.489327 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-df8713b2-6edd-4cca-9ccc-3d539d33f409 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:17.489722 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-df8713b2-6edd-4cca-9ccc-3d539d33f409 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:17.490500 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-df8713b2-6edd-4cca-9ccc-3d539d33f409 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:17.490976 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-df8713b2-6edd-4cca-9ccc-3d539d33f409 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:17.567867 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-df8713b2-6edd-4cca-9ccc-3d539d33f409 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:17.578728 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-df8713b2-6edd-4cca-9ccc-3d539d33f409 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1241 microversion: 2.1 time: 0.101825 Aug 03 19:03:17.580019 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 26/55] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:17 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1241 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:17.965715 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-762bc31a-d719-4e58-8a24-9f21411696bb tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:17.966400 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-762bc31a-d719-4e58-8a24-9f21411696bb tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:17.974813 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-762bc31a-d719-4e58-8a24-9f21411696bb tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:17.975353 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-762bc31a-d719-4e58-8a24-9f21411696bb tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:17.976371 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-762bc31a-d719-4e58-8a24-9f21411696bb tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:17.976848 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-762bc31a-d719-4e58-8a24-9f21411696bb tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:18.055504 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-762bc31a-d719-4e58-8a24-9f21411696bb tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:18.065751 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-762bc31a-d719-4e58-8a24-9f21411696bb tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1267 microversion: 2.1 time: 0.104244 Aug 03 19:03:18.066313 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 30/56] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:17 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1267 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:18.489669 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-2adb4667-4a24-4770-9550-381d1370a4ee tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:18.490725 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-2adb4667-4a24-4770-9550-381d1370a4ee tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:18.505755 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2adb4667-4a24-4770-9550-381d1370a4ee tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:18.506223 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2adb4667-4a24-4770-9550-381d1370a4ee tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:18.507074 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2adb4667-4a24-4770-9550-381d1370a4ee tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:18.507526 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2adb4667-4a24-4770-9550-381d1370a4ee tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:18.598516 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-2adb4667-4a24-4770-9550-381d1370a4ee tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:18.602079 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-c3960a93-d646-4fd7-b5ed-99b62e6d322e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:18.602857 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-c3960a93-d646-4fd7-b5ed-99b62e6d322e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:18.612777 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-2adb4667-4a24-4770-9550-381d1370a4ee tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1274 microversion: 2.1 time: 0.130022 Aug 03 19:03:18.615278 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 27/57] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:18 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1274 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:18.632659 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c3960a93-d646-4fd7-b5ed-99b62e6d322e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:18.632659 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c3960a93-d646-4fd7-b5ed-99b62e6d322e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:18.632659 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c3960a93-d646-4fd7-b5ed-99b62e6d322e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:18.632659 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c3960a93-d646-4fd7-b5ed-99b62e6d322e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:18.778766 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-c3960a93-d646-4fd7-b5ed-99b62e6d322e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:18.791630 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-c3960a93-d646-4fd7-b5ed-99b62e6d322e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1241 microversion: 2.1 time: 0.194885 Aug 03 19:03:18.804673 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 31/58] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:18 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1241 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:03:19.092933 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-148e9922-e1dc-4d8e-a201-84eb6698ec2d tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:19.094559 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-148e9922-e1dc-4d8e-a201-84eb6698ec2d tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:19.118378 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-148e9922-e1dc-4d8e-a201-84eb6698ec2d tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:19.124065 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-148e9922-e1dc-4d8e-a201-84eb6698ec2d tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:19.126206 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-148e9922-e1dc-4d8e-a201-84eb6698ec2d tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:19.128102 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-148e9922-e1dc-4d8e-a201-84eb6698ec2d tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:19.390463 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-148e9922-e1dc-4d8e-a201-84eb6698ec2d tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:19.405756 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-148e9922-e1dc-4d8e-a201-84eb6698ec2d tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1285 microversion: 2.1 time: 0.318568 Aug 03 19:03:19.406974 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 28/59] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:19 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1285 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:19.641647 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-b622ffd4-83f4-420c-8607-70057fa5c63f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:19.642806 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-b622ffd4-83f4-420c-8607-70057fa5c63f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:19.651840 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b622ffd4-83f4-420c-8607-70057fa5c63f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:19.653457 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b622ffd4-83f4-420c-8607-70057fa5c63f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:19.655622 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b622ffd4-83f4-420c-8607-70057fa5c63f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:19.656756 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b622ffd4-83f4-420c-8607-70057fa5c63f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:19.813729 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-acb32ea0-f936-4189-aaf8-fb2470aec604 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:19.814436 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-acb32ea0-f936-4189-aaf8-fb2470aec604 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:19.830501 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-acb32ea0-f936-4189-aaf8-fb2470aec604 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:19.831202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-acb32ea0-f936-4189-aaf8-fb2470aec604 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:19.832026 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-acb32ea0-f936-4189-aaf8-fb2470aec604 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:19.832471 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-acb32ea0-f936-4189-aaf8-fb2470aec604 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:19.907455 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell0:SELECT=2 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:03:20.125554 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-b622ffd4-83f4-420c-8607-70057fa5c63f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:20.134320 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-acb32ea0-f936-4189-aaf8-fb2470aec604 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:20.144051 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-b622ffd4-83f4-420c-8607-70057fa5c63f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1292 microversion: 2.1 time: 0.506329 Aug 03 19:03:20.147635 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 32/60] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:19 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1292 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:20.155499 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-acb32ea0-f936-4189-aaf8-fb2470aec604 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1289 microversion: 2.1 time: 0.345280 Aug 03 19:03:20.158034 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 29/61] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:19 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1289 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:03:20.450820 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-abedac1c-7675-424f-a51a-0db4d2a1b561 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:20.450820 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-abedac1c-7675-424f-a51a-0db4d2a1b561 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:20.473950 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-abedac1c-7675-424f-a51a-0db4d2a1b561 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:20.474528 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-abedac1c-7675-424f-a51a-0db4d2a1b561 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:20.476100 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-abedac1c-7675-424f-a51a-0db4d2a1b561 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:20.481068 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-abedac1c-7675-424f-a51a-0db4d2a1b561 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:20.720649 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-abedac1c-7675-424f-a51a-0db4d2a1b561 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:20.731577 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-abedac1c-7675-424f-a51a-0db4d2a1b561 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1273 microversion: 2.1 time: 0.295985 Aug 03 19:03:20.732383 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 33/62] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:20 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1273 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:21.183673 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-7651c0a1-8866-4595-a363-662150aa2a9b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:21.184966 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-7651c0a1-8866-4595-a363-662150aa2a9b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:21.185525 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-77a05ac2-9f0a-4c54-bc32-184cd03776c7 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:21.187831 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-77a05ac2-9f0a-4c54-bc32-184cd03776c7 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:21.204983 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-7651c0a1-8866-4595-a363-662150aa2a9b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:21.206150 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-7651c0a1-8866-4595-a363-662150aa2a9b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:21.207912 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-7651c0a1-8866-4595-a363-662150aa2a9b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:21.208703 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-7651c0a1-8866-4595-a363-662150aa2a9b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:21.209327 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-77a05ac2-9f0a-4c54-bc32-184cd03776c7 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:21.211919 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-77a05ac2-9f0a-4c54-bc32-184cd03776c7 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:21.215624 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-77a05ac2-9f0a-4c54-bc32-184cd03776c7 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:21.216664 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-77a05ac2-9f0a-4c54-bc32-184cd03776c7 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:21.367631 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-7651c0a1-8866-4595-a363-662150aa2a9b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:21.382253 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-7651c0a1-8866-4595-a363-662150aa2a9b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1289 microversion: 2.1 time: 0.203981 Aug 03 19:03:21.383543 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 34/63] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:21 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1289 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:21.539319 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-77a05ac2-9f0a-4c54-bc32-184cd03776c7 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:21.555335 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-77a05ac2-9f0a-4c54-bc32-184cd03776c7 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1334 microversion: 2.1 time: 0.384657 Aug 03 19:03:21.556146 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 30/64] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:21 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1334 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:21.768173 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-adb103f2-5e1b-495b-a788-93d39959f855 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:21.769299 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-adb103f2-5e1b-495b-a788-93d39959f855 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:21.781159 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-adb103f2-5e1b-495b-a788-93d39959f855 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:21.782331 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-adb103f2-5e1b-495b-a788-93d39959f855 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:21.785118 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-adb103f2-5e1b-495b-a788-93d39959f855 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:21.786168 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-adb103f2-5e1b-495b-a788-93d39959f855 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:21.930161 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-adb103f2-5e1b-495b-a788-93d39959f855 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:21.939582 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-adb103f2-5e1b-495b-a788-93d39959f855 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1273 microversion: 2.1 time: 0.182762 Aug 03 19:03:21.940969 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 35/65] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:21 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1273 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:22.410194 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-f5a45a28-ed5c-4fa2-85d5-4fcc7d9136db tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:22.410887 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-f5a45a28-ed5c-4fa2-85d5-4fcc7d9136db tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:22.421927 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f5a45a28-ed5c-4fa2-85d5-4fcc7d9136db tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:22.422029 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f5a45a28-ed5c-4fa2-85d5-4fcc7d9136db tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:22.422818 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f5a45a28-ed5c-4fa2-85d5-4fcc7d9136db tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:22.423294 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f5a45a28-ed5c-4fa2-85d5-4fcc7d9136db tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:22.514844 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-f5a45a28-ed5c-4fa2-85d5-4fcc7d9136db tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:22.531831 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-f5a45a28-ed5c-4fa2-85d5-4fcc7d9136db tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1289 microversion: 2.1 time: 0.119725 Aug 03 19:03:22.533756 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 31/66] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:22 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1289 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:22.577864 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-1d971844-ccf8-4225-8f2f-1a40cdd67674 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:22.578419 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-1d971844-ccf8-4225-8f2f-1a40cdd67674 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:22.586073 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1d971844-ccf8-4225-8f2f-1a40cdd67674 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:22.586682 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1d971844-ccf8-4225-8f2f-1a40cdd67674 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:22.587686 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1d971844-ccf8-4225-8f2f-1a40cdd67674 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:22.588081 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1d971844-ccf8-4225-8f2f-1a40cdd67674 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:22.802075 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-1d971844-ccf8-4225-8f2f-1a40cdd67674 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:22.817181 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-1d971844-ccf8-4225-8f2f-1a40cdd67674 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1322 microversion: 2.1 time: 0.243351 Aug 03 19:03:22.818502 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 36/67] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:22 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:22.964197 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-3d0f7c2a-b6f7-4fe5-8861-895d23d8310d tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:22.964197 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-3d0f7c2a-b6f7-4fe5-8861-895d23d8310d tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:22.984962 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3d0f7c2a-b6f7-4fe5-8861-895d23d8310d tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:22.989572 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3d0f7c2a-b6f7-4fe5-8861-895d23d8310d tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:22.989572 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3d0f7c2a-b6f7-4fe5-8861-895d23d8310d tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:22.989572 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3d0f7c2a-b6f7-4fe5-8861-895d23d8310d tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:23.144414 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell0:SELECT=6 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:03:23.197502 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell0:SELECT=20 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:03:23.276933 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-3d0f7c2a-b6f7-4fe5-8861-895d23d8310d tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:23.306395 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-3d0f7c2a-b6f7-4fe5-8861-895d23d8310d tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1315 microversion: 2.1 time: 0.343405 Aug 03 19:03:23.306395 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 32/68] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:22 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:23.556932 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-50a1e032-4d49-45ba-bd82-6cfbbc0e012c tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:23.558355 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-50a1e032-4d49-45ba-bd82-6cfbbc0e012c tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:23.569186 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-50a1e032-4d49-45ba-bd82-6cfbbc0e012c tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:23.571882 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-50a1e032-4d49-45ba-bd82-6cfbbc0e012c tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:23.573484 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-50a1e032-4d49-45ba-bd82-6cfbbc0e012c tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:23.575900 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-50a1e032-4d49-45ba-bd82-6cfbbc0e012c tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:23.749825 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-50a1e032-4d49-45ba-bd82-6cfbbc0e012c tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:23.761927 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-50a1e032-4d49-45ba-bd82-6cfbbc0e012c tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1289 microversion: 2.1 time: 0.209862 Aug 03 19:03:23.779661 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 37/69] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:23 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1289 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:23.853975 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-ae65b3e5-0949-4c68-9995-6a6addaedd7a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:23.855616 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-ae65b3e5-0949-4c68-9995-6a6addaedd7a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:23.864222 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ae65b3e5-0949-4c68-9995-6a6addaedd7a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:23.865269 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ae65b3e5-0949-4c68-9995-6a6addaedd7a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:23.866855 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ae65b3e5-0949-4c68-9995-6a6addaedd7a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:23.868335 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ae65b3e5-0949-4c68-9995-6a6addaedd7a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:24.092544 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-ae65b3e5-0949-4c68-9995-6a6addaedd7a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:24.111913 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-ae65b3e5-0949-4c68-9995-6a6addaedd7a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1322 microversion: 2.1 time: 0.254739 Aug 03 19:03:24.111913 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 33/70] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:23 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:24.326618 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-a26a9634-3df7-4b1d-a4ba-9d3cf7d7be64 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:24.327352 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-a26a9634-3df7-4b1d-a4ba-9d3cf7d7be64 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:24.329685 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell0:SELECT=20 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:03:24.342069 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a26a9634-3df7-4b1d-a4ba-9d3cf7d7be64 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:24.342507 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a26a9634-3df7-4b1d-a4ba-9d3cf7d7be64 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:24.343501 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a26a9634-3df7-4b1d-a4ba-9d3cf7d7be64 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:24.344049 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a26a9634-3df7-4b1d-a4ba-9d3cf7d7be64 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:24.585749 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-a26a9634-3df7-4b1d-a4ba-9d3cf7d7be64 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:24.595271 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-a26a9634-3df7-4b1d-a4ba-9d3cf7d7be64 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1315 microversion: 2.1 time: 0.273195 Aug 03 19:03:24.596825 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 38/71] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:24 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:24.796311 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-83becef9-2d03-4ddd-bc20-ec4cad398b70 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:24.797462 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-83becef9-2d03-4ddd-bc20-ec4cad398b70 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:24.810152 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-83becef9-2d03-4ddd-bc20-ec4cad398b70 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:24.811590 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-83becef9-2d03-4ddd-bc20-ec4cad398b70 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:24.811590 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-83becef9-2d03-4ddd-bc20-ec4cad398b70 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:24.811928 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-83becef9-2d03-4ddd-bc20-ec4cad398b70 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:24.947283 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-83becef9-2d03-4ddd-bc20-ec4cad398b70 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:24.961665 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-83becef9-2d03-4ddd-bc20-ec4cad398b70 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1289 microversion: 2.1 time: 0.169653 Aug 03 19:03:24.967055 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 34/72] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:24 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1289 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:25.146896 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-0583ebdc-6386-420d-b623-c0a230b69861 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:25.148910 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-0583ebdc-6386-420d-b623-c0a230b69861 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:25.164226 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0583ebdc-6386-420d-b623-c0a230b69861 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:25.165744 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0583ebdc-6386-420d-b623-c0a230b69861 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:25.167750 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0583ebdc-6386-420d-b623-c0a230b69861 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:25.169193 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0583ebdc-6386-420d-b623-c0a230b69861 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:25.403308 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-0583ebdc-6386-420d-b623-c0a230b69861 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:25.418552 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-0583ebdc-6386-420d-b623-c0a230b69861 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1322 microversion: 2.1 time: 0.278727 Aug 03 19:03:25.420131 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 39/73] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:25 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1322 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:25.649069 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-26b0c5f7-4127-4579-81c6-33b999377854 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:25.650088 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-26b0c5f7-4127-4579-81c6-33b999377854 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:25.663571 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-26b0c5f7-4127-4579-81c6-33b999377854 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:25.664806 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-26b0c5f7-4127-4579-81c6-33b999377854 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:25.670679 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-26b0c5f7-4127-4579-81c6-33b999377854 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:25.670679 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-26b0c5f7-4127-4579-81c6-33b999377854 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:25.985444 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-8efb4001-280f-431e-8f11-31dc164a149b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:25.986476 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-8efb4001-280f-431e-8f11-31dc164a149b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:26.001851 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8efb4001-280f-431e-8f11-31dc164a149b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:26.004177 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8efb4001-280f-431e-8f11-31dc164a149b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:26.011933 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8efb4001-280f-431e-8f11-31dc164a149b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:26.012534 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8efb4001-280f-431e-8f11-31dc164a149b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:26.035166 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=100 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:03:26.301738 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-8efb4001-280f-431e-8f11-31dc164a149b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:26.335736 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-8efb4001-280f-431e-8f11-31dc164a149b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1297 microversion: 2.1 time: 0.354380 Aug 03 19:03:26.342146 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 40/74] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:25 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1297 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:26.343804 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-26b0c5f7-4127-4579-81c6-33b999377854 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:26.384440 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-26b0c5f7-4127-4579-81c6-33b999377854 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1315 microversion: 2.1 time: 0.749121 Aug 03 19:03:26.385995 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 35/75] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:25 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1315 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:26.454738 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-daf272a6-197d-4912-89d4-66276457c14b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:26.462253 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-daf272a6-197d-4912-89d4-66276457c14b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:26.488643 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-daf272a6-197d-4912-89d4-66276457c14b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:26.489845 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-daf272a6-197d-4912-89d4-66276457c14b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:26.490042 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-daf272a6-197d-4912-89d4-66276457c14b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:26.490847 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-daf272a6-197d-4912-89d4-66276457c14b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:27.387426 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-daf272a6-197d-4912-89d4-66276457c14b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:27.390590 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-ddacc1ff-ea6a-4017-8f22-e2617e01f3c8 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:27.392683 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-ddacc1ff-ea6a-4017-8f22-e2617e01f3c8 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:27.408805 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ddacc1ff-ea6a-4017-8f22-e2617e01f3c8 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:27.411018 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-daf272a6-197d-4912-89d4-66276457c14b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1322 microversion: 2.1 time: 0.966154 Aug 03 19:03:27.411345 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ddacc1ff-ea6a-4017-8f22-e2617e01f3c8 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:27.413845 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ddacc1ff-ea6a-4017-8f22-e2617e01f3c8 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:27.415252 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ddacc1ff-ea6a-4017-8f22-e2617e01f3c8 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:27.428307 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 41/76] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:26 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1322 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:03:27.461789 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-bb238e62-9b72-4927-9db8-8ad0ff01fd62 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:27.467936 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-bb238e62-9b72-4927-9db8-8ad0ff01fd62 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:27.486885 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-bb238e62-9b72-4927-9db8-8ad0ff01fd62 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:27.488456 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-bb238e62-9b72-4927-9db8-8ad0ff01fd62 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:27.490377 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-bb238e62-9b72-4927-9db8-8ad0ff01fd62 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:27.491861 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-bb238e62-9b72-4927-9db8-8ad0ff01fd62 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:27.855745 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-ddacc1ff-ea6a-4017-8f22-e2617e01f3c8 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:27.913187 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-ddacc1ff-ea6a-4017-8f22-e2617e01f3c8 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1295 microversion: 2.1 time: 0.519338 Aug 03 19:03:27.922246 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 36/77] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:27 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1295 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:28.015427 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-bb238e62-9b72-4927-9db8-8ad0ff01fd62 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:28.028202 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-bb238e62-9b72-4927-9db8-8ad0ff01fd62 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1315 microversion: 2.1 time: 0.595109 Aug 03 19:03:28.028202 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 42/78] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:27 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1315 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:28.460769 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-0352947e-7738-4c34-b6c1-f3d347f2523e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:28.465955 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-0352947e-7738-4c34-b6c1-f3d347f2523e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:28.483515 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0352947e-7738-4c34-b6c1-f3d347f2523e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:28.496503 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0352947e-7738-4c34-b6c1-f3d347f2523e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:28.499566 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0352947e-7738-4c34-b6c1-f3d347f2523e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:28.526921 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0352947e-7738-4c34-b6c1-f3d347f2523e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:28.631899 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=100 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:03:28.960112 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-381391b1-96cb-49c7-a4a8-1ff4ad4ee2c7 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:28.963182 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-381391b1-96cb-49c7-a4a8-1ff4ad4ee2c7 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:29.000856 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-381391b1-96cb-49c7-a4a8-1ff4ad4ee2c7 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:29.011345 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-381391b1-96cb-49c7-a4a8-1ff4ad4ee2c7 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:29.020883 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-381391b1-96cb-49c7-a4a8-1ff4ad4ee2c7 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:29.020883 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-381391b1-96cb-49c7-a4a8-1ff4ad4ee2c7 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:29.484812 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-381391b1-96cb-49c7-a4a8-1ff4ad4ee2c7 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:29.542408 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-381391b1-96cb-49c7-a4a8-1ff4ad4ee2c7 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1295 microversion: 2.1 time: 0.585475 Aug 03 19:03:29.543971 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 43/79] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:28 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1295 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:29.563863 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-7f0fab74-f74d-46b2-9bf5-b9e0b906bdfc tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:29.567082 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-7f0fab74-f74d-46b2-9bf5-b9e0b906bdfc tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:29.601688 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-7f0fab74-f74d-46b2-9bf5-b9e0b906bdfc tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:29.601688 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-7f0fab74-f74d-46b2-9bf5-b9e0b906bdfc tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:29.601688 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-7f0fab74-f74d-46b2-9bf5-b9e0b906bdfc tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:29.601688 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-7f0fab74-f74d-46b2-9bf5-b9e0b906bdfc tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:29.627954 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-0352947e-7738-4c34-b6c1-f3d347f2523e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:29.648996 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-0352947e-7738-4c34-b6c1-f3d347f2523e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1322 microversion: 2.1 time: 1.201678 Aug 03 19:03:29.651506 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 37/80] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:28 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1322 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:29.996039 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-7f0fab74-f74d-46b2-9bf5-b9e0b906bdfc tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:30.025736 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-7f0fab74-f74d-46b2-9bf5-b9e0b906bdfc tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1315 microversion: 2.1 time: 0.479049 Aug 03 19:03:30.028747 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 44/81] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:29 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1315 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:30.388232 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-71322a1f-141d-4edb-a349-6b95e81c0055 req-435b1d0f-03ed-424c-ad7a-f6992bdde93f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54ad07ab-f23e-4369-8940-65095533457d", "tag": "14f5d67f-5c4d-441e-993c-111e289fd40a"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:03:30.441992 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-71322a1f-141d-4edb-a349-6b95e81c0055 req-435b1d0f-03ed-424c-ad7a-f6992bdde93f service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:30.442404 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-71322a1f-141d-4edb-a349-6b95e81c0055 req-435b1d0f-03ed-424c-ad7a-f6992bdde93f service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:30.481875 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-71322a1f-141d-4edb-a349-6b95e81c0055 req-435b1d0f-03ed-424c-ad7a-f6992bdde93f service nova] Creating event network-changed:14f5d67f-5c4d-441e-993c-111e289fd40a for instance 54ad07ab-f23e-4369-8940-65095533457d on hv-cinder-85202 Aug 03 19:03:30.483514 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-71322a1f-141d-4edb-a349-6b95e81c0055 req-435b1d0f-03ed-424c-ad7a-f6992bdde93f service nova] Acquired lock "compute-rpcapi-router" {{(pid=118302) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 03 19:03:30.485243 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c0b8a7fd-f518-4378-86d1-6c66dcc8bf2f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:30.485883 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c0b8a7fd-f518-4378-86d1-6c66dcc8bf2f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:30.487213 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c0b8a7fd-f518-4378-86d1-6c66dcc8bf2f None None] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:30.487884 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c0b8a7fd-f518-4378-86d1-6c66dcc8bf2f None None] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:30.501371 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.compute.rpcapi [None req-c0b8a7fd-f518-4378-86d1-6c66dcc8bf2f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 03 19:03:30.507560 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c0b8a7fd-f518-4378-86d1-6c66dcc8bf2f None None] Releasing lock "compute-rpcapi-router" {{(pid=118302) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 03 19:03:30.527764 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-c0b8a7fd-f518-4378-86d1-6c66dcc8bf2f None None] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.702134 Aug 03 19:03:30.529334 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 38/82] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 19:03:30.573551 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-d834e2fa-fe94-4fbc-b53d-c71b1e0595af tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:30.573551 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-d834e2fa-fe94-4fbc-b53d-c71b1e0595af tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:30.580118 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d834e2fa-fe94-4fbc-b53d-c71b1e0595af tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:30.580585 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d834e2fa-fe94-4fbc-b53d-c71b1e0595af tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:30.581466 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d834e2fa-fe94-4fbc-b53d-c71b1e0595af tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:30.581943 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d834e2fa-fe94-4fbc-b53d-c71b1e0595af tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:30.677714 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-ef83583a-45bc-46e6-bc05-6ef295c8cd2e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:30.678742 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-ef83583a-45bc-46e6-bc05-6ef295c8cd2e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:30.714931 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ef83583a-45bc-46e6-bc05-6ef295c8cd2e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:30.718831 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ef83583a-45bc-46e6-bc05-6ef295c8cd2e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:30.724350 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ef83583a-45bc-46e6-bc05-6ef295c8cd2e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:30.725332 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ef83583a-45bc-46e6-bc05-6ef295c8cd2e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:30.853488 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-d834e2fa-fe94-4fbc-b53d-c71b1e0595af tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:30.868426 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-d834e2fa-fe94-4fbc-b53d-c71b1e0595af tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1363 microversion: 2.1 time: 0.302924 Aug 03 19:03:30.869377 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 45/83] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:30 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1363 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:31.000380 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-ef83583a-45bc-46e6-bc05-6ef295c8cd2e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:31.016006 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-ef83583a-45bc-46e6-bc05-6ef295c8cd2e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1322 microversion: 2.1 time: 0.345073 Aug 03 19:03:31.017309 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 39/84] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:30 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1322 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:03:31.089709 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-8f6936f2-2286-460e-9c59-07b4c4d2c778 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:31.089709 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-8f6936f2-2286-460e-9c59-07b4c4d2c778 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:31.117214 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8f6936f2-2286-460e-9c59-07b4c4d2c778 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:31.119168 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8f6936f2-2286-460e-9c59-07b4c4d2c778 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:31.121467 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8f6936f2-2286-460e-9c59-07b4c4d2c778 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:31.122426 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8f6936f2-2286-460e-9c59-07b4c4d2c778 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:31.487241 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-8f6936f2-2286-460e-9c59-07b4c4d2c778 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:31.503108 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-8f6936f2-2286-460e-9c59-07b4c4d2c778 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1315 microversion: 2.1 time: 0.430083 Aug 03 19:03:31.504091 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 46/85] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:31 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1315 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:31.527309 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-b15a3bde-5817-4868-bccd-b863c1f0baba req-108f34e7-5f5d-4b57-915a-459d6a75e06a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "272088aa-31e7-465f-a224-b49f3a86497c", "tag": "77e656cc-d42d-42c8-bbff-4d87ddc50476"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:03:31.543960 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-b15a3bde-5817-4868-bccd-b863c1f0baba req-108f34e7-5f5d-4b57-915a-459d6a75e06a service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:31.544656 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-b15a3bde-5817-4868-bccd-b863c1f0baba req-108f34e7-5f5d-4b57-915a-459d6a75e06a service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:31.563695 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-b15a3bde-5817-4868-bccd-b863c1f0baba req-108f34e7-5f5d-4b57-915a-459d6a75e06a service nova] Creating event network-changed:77e656cc-d42d-42c8-bbff-4d87ddc50476 for instance 272088aa-31e7-465f-a224-b49f3a86497c on hv-cinder-85202 Aug 03 19:03:31.570877 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-b15a3bde-5817-4868-bccd-b863c1f0baba req-108f34e7-5f5d-4b57-915a-459d6a75e06a service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159461 Aug 03 19:03:31.571540 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 40/86] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 19:03:31.906319 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-cff70da9-f0d4-48ac-8e7a-80a3feffe739 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:31.907765 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-cff70da9-f0d4-48ac-8e7a-80a3feffe739 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:31.919085 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cff70da9-f0d4-48ac-8e7a-80a3feffe739 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:31.919873 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cff70da9-f0d4-48ac-8e7a-80a3feffe739 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:31.921194 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cff70da9-f0d4-48ac-8e7a-80a3feffe739 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:31.921902 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cff70da9-f0d4-48ac-8e7a-80a3feffe739 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:32.067049 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-580941db-8c2e-48cc-baae-a4c57365f881 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:32.079349 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-580941db-8c2e-48cc-baae-a4c57365f881 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:32.117096 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-580941db-8c2e-48cc-baae-a4c57365f881 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:32.117096 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-580941db-8c2e-48cc-baae-a4c57365f881 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:32.127833 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-580941db-8c2e-48cc-baae-a4c57365f881 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:32.128633 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-580941db-8c2e-48cc-baae-a4c57365f881 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:32.344534 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-cff70da9-f0d4-48ac-8e7a-80a3feffe739 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:32.355822 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-cff70da9-f0d4-48ac-8e7a-80a3feffe739 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1363 microversion: 2.1 time: 0.454520 Aug 03 19:03:32.357127 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 47/87] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:31 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1363 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:32.469880 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-580941db-8c2e-48cc-baae-a4c57365f881 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:32.479309 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-580941db-8c2e-48cc-baae-a4c57365f881 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1322 microversion: 2.1 time: 0.429065 Aug 03 19:03:32.485010 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 41/88] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:32 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1322 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:32.534317 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-da9fd2ec-61d9-4cd9-a778-cc9a5b3f5fbb tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:32.535749 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-da9fd2ec-61d9-4cd9-a778-cc9a5b3f5fbb tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:32.548591 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-da9fd2ec-61d9-4cd9-a778-cc9a5b3f5fbb tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:32.550273 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-da9fd2ec-61d9-4cd9-a778-cc9a5b3f5fbb tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:32.552332 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-da9fd2ec-61d9-4cd9-a778-cc9a5b3f5fbb tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:32.553529 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-da9fd2ec-61d9-4cd9-a778-cc9a5b3f5fbb tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:32.822158 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-da9fd2ec-61d9-4cd9-a778-cc9a5b3f5fbb tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:32.836732 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-da9fd2ec-61d9-4cd9-a778-cc9a5b3f5fbb tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1315 microversion: 2.1 time: 0.309788 Aug 03 19:03:32.837819 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 48/89] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:32 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:33.391644 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-97f3805e-f63a-48ce-b52b-2473c23c197d tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:33.392525 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-97f3805e-f63a-48ce-b52b-2473c23c197d tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:33.399539 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-97f3805e-f63a-48ce-b52b-2473c23c197d tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:33.400035 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-97f3805e-f63a-48ce-b52b-2473c23c197d tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:33.401964 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-97f3805e-f63a-48ce-b52b-2473c23c197d tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:33.402975 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-97f3805e-f63a-48ce-b52b-2473c23c197d tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:33.516175 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-a095e43e-2f74-438e-8ae0-012ee2ab9a93 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:33.521454 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-a095e43e-2f74-438e-8ae0-012ee2ab9a93 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:33.529884 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:03:33.536929 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a095e43e-2f74-438e-8ae0-012ee2ab9a93 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:33.537651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a095e43e-2f74-438e-8ae0-012ee2ab9a93 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:33.538974 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a095e43e-2f74-438e-8ae0-012ee2ab9a93 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:33.539996 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a095e43e-2f74-438e-8ae0-012ee2ab9a93 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:33.711663 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-97f3805e-f63a-48ce-b52b-2473c23c197d tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:33.728370 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-97f3805e-f63a-48ce-b52b-2473c23c197d tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1363 microversion: 2.1 time: 0.342220 Aug 03 19:03:33.731290 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 42/90] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:33 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1363 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:33.740710 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-ee492402-2cb6-4042-87d0-fab26b987bc1 req-d7205545-33b2-48a6-a828-7251430e13bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82aa6775-8d66-4d67-af69-104454485a2a", "tag": "1932c7bb-4cf4-4b3d-af32-ca8b71b79229"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:03:33.758164 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-ee492402-2cb6-4042-87d0-fab26b987bc1 req-d7205545-33b2-48a6-a828-7251430e13bf service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:33.759155 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-ee492402-2cb6-4042-87d0-fab26b987bc1 req-d7205545-33b2-48a6-a828-7251430e13bf service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:33.785663 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-ee492402-2cb6-4042-87d0-fab26b987bc1 req-d7205545-33b2-48a6-a828-7251430e13bf service nova] Creating event network-changed:1932c7bb-4cf4-4b3d-af32-ca8b71b79229 for instance 82aa6775-8d66-4d67-af69-104454485a2a on hv-cinder-85202 Aug 03 19:03:33.795228 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-ee492402-2cb6-4042-87d0-fab26b987bc1 req-d7205545-33b2-48a6-a828-7251430e13bf service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061415 Aug 03 19:03:33.796857 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 43/91] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:03:33.859903 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-a095e43e-2f74-438e-8ae0-012ee2ab9a93 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:33.876149 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-0d214df1-6491-4b0c-a8ea-96a3ff46bde0 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:33.877758 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-0d214df1-6491-4b0c-a8ea-96a3ff46bde0 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:33.886534 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:03:33.898580 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-a095e43e-2f74-438e-8ae0-012ee2ab9a93 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1322 microversion: 2.1 time: 0.380404 Aug 03 19:03:33.898580 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 49/92] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:33 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1322 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:03:33.898936 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0d214df1-6491-4b0c-a8ea-96a3ff46bde0 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:33.898936 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0d214df1-6491-4b0c-a8ea-96a3ff46bde0 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:33.898936 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0d214df1-6491-4b0c-a8ea-96a3ff46bde0 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:33.899400 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0d214df1-6491-4b0c-a8ea-96a3ff46bde0 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:34.275161 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-0d214df1-6491-4b0c-a8ea-96a3ff46bde0 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:34.291428 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-0d214df1-6491-4b0c-a8ea-96a3ff46bde0 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1315 microversion: 2.1 time: 0.426585 Aug 03 19:03:34.293586 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 44/93] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:33 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1315 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:03:34.776634 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-0d2c06dc-5dcb-4fc2-857a-b1117eae5111 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:34.779495 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-0d2c06dc-5dcb-4fc2-857a-b1117eae5111 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:34.790561 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0d2c06dc-5dcb-4fc2-857a-b1117eae5111 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:34.791843 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0d2c06dc-5dcb-4fc2-857a-b1117eae5111 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:34.793437 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0d2c06dc-5dcb-4fc2-857a-b1117eae5111 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:34.794340 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0d2c06dc-5dcb-4fc2-857a-b1117eae5111 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:34.930892 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-e7a07e08-8401-470e-9fe9-ecb6fdc2314a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:34.932707 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-e7a07e08-8401-470e-9fe9-ecb6fdc2314a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:34.959554 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e7a07e08-8401-470e-9fe9-ecb6fdc2314a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:34.960738 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e7a07e08-8401-470e-9fe9-ecb6fdc2314a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:34.965148 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e7a07e08-8401-470e-9fe9-ecb6fdc2314a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:34.975123 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e7a07e08-8401-470e-9fe9-ecb6fdc2314a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:35.163471 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-0d2c06dc-5dcb-4fc2-857a-b1117eae5111 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:35.190586 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-0d2c06dc-5dcb-4fc2-857a-b1117eae5111 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1363 microversion: 2.1 time: 0.441879 Aug 03 19:03:35.193624 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 50/94] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:34 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1363 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:35.337351 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-5ca0d530-497e-47b5-b59a-b8079c01f22b tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:35.340561 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-5ca0d530-497e-47b5-b59a-b8079c01f22b tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:35.372640 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5ca0d530-497e-47b5-b59a-b8079c01f22b tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:35.373418 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5ca0d530-497e-47b5-b59a-b8079c01f22b tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:35.381362 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5ca0d530-497e-47b5-b59a-b8079c01f22b tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:35.381362 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5ca0d530-497e-47b5-b59a-b8079c01f22b tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:35.698933 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-e7a07e08-8401-470e-9fe9-ecb6fdc2314a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:35.716391 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-e7a07e08-8401-470e-9fe9-ecb6fdc2314a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1322 microversion: 2.1 time: 0.791095 Aug 03 19:03:35.717886 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 45/95] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:34 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1322 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:35.961941 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-5ca0d530-497e-47b5-b59a-b8079c01f22b tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:35.997236 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-5ca0d530-497e-47b5-b59a-b8079c01f22b tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1315 microversion: 2.1 time: 0.676647 Aug 03 19:03:36.006927 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 51/96] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:35 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1315 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:03:36.230419 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-c527ec1c-7b7d-4bd8-ab9b-5a5d42928382 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:36.232855 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-c527ec1c-7b7d-4bd8-ab9b-5a5d42928382 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:36.274525 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c527ec1c-7b7d-4bd8-ab9b-5a5d42928382 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:36.275704 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c527ec1c-7b7d-4bd8-ab9b-5a5d42928382 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:36.289935 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c527ec1c-7b7d-4bd8-ab9b-5a5d42928382 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:36.291062 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c527ec1c-7b7d-4bd8-ab9b-5a5d42928382 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:36.588693 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-c527ec1c-7b7d-4bd8-ab9b-5a5d42928382 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:36.602525 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-c527ec1c-7b7d-4bd8-ab9b-5a5d42928382 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1363 microversion: 2.1 time: 0.379345 Aug 03 19:03:36.622617 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 46/97] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:36 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1363 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:36.744175 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-fc0adfe6-1d06-4042-99c8-114d0e6dd41a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:36.764297 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-fc0adfe6-1d06-4042-99c8-114d0e6dd41a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:36.781072 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fc0adfe6-1d06-4042-99c8-114d0e6dd41a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:36.782064 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fc0adfe6-1d06-4042-99c8-114d0e6dd41a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:36.783048 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fc0adfe6-1d06-4042-99c8-114d0e6dd41a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:36.783638 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fc0adfe6-1d06-4042-99c8-114d0e6dd41a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:37.034614 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-1fed3065-0185-486d-8f05-d048357602e7 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:37.042602 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-1fed3065-0185-486d-8f05-d048357602e7 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:37.069737 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1fed3065-0185-486d-8f05-d048357602e7 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:37.073312 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1fed3065-0185-486d-8f05-d048357602e7 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:37.075809 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1fed3065-0185-486d-8f05-d048357602e7 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:37.093280 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1fed3065-0185-486d-8f05-d048357602e7 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:37.868815 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-1fed3065-0185-486d-8f05-d048357602e7 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:37.909393 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-fc0adfe6-1d06-4042-99c8-114d0e6dd41a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:37.922986 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-1fed3065-0185-486d-8f05-d048357602e7 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1315 microversion: 2.1 time: 0.901406 Aug 03 19:03:37.934656 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 47/98] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:37 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1315 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:37.944015 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-fc0adfe6-1d06-4042-99c8-114d0e6dd41a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1322 microversion: 2.1 time: 1.206290 Aug 03 19:03:37.953942 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-c1b9df8e-6f17-45dd-a8da-7c43ae4e84b1 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:37.955781 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 52/99] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:36 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1322 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:37.958183 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-c1b9df8e-6f17-45dd-a8da-7c43ae4e84b1 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:37.980664 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c1b9df8e-6f17-45dd-a8da-7c43ae4e84b1 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:37.984003 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c1b9df8e-6f17-45dd-a8da-7c43ae4e84b1 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:37.986267 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c1b9df8e-6f17-45dd-a8da-7c43ae4e84b1 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:37.989504 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c1b9df8e-6f17-45dd-a8da-7c43ae4e84b1 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:38.717190 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-c1b9df8e-6f17-45dd-a8da-7c43ae4e84b1 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:38.729245 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-c1b9df8e-6f17-45dd-a8da-7c43ae4e84b1 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1363 microversion: 2.1 time: 0.791788 Aug 03 19:03:38.734817 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 48/100] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:37 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1363 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:38.955594 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-6e9a2c1c-15df-4dba-86b4-96b2f44a68d2 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:38.956998 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-6e9a2c1c-15df-4dba-86b4-96b2f44a68d2 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:38.975078 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6e9a2c1c-15df-4dba-86b4-96b2f44a68d2 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:38.977366 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6e9a2c1c-15df-4dba-86b4-96b2f44a68d2 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:38.981042 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6e9a2c1c-15df-4dba-86b4-96b2f44a68d2 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:38.986330 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6e9a2c1c-15df-4dba-86b4-96b2f44a68d2 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:38.994183 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-e33cebb7-53da-4f4c-aff1-02aa329a2633 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:38.997692 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-e33cebb7-53da-4f4c-aff1-02aa329a2633 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:39.026711 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e33cebb7-53da-4f4c-aff1-02aa329a2633 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:39.039732 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e33cebb7-53da-4f4c-aff1-02aa329a2633 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:39.044315 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e33cebb7-53da-4f4c-aff1-02aa329a2633 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:39.045796 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e33cebb7-53da-4f4c-aff1-02aa329a2633 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:39.867098 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-6e9a2c1c-15df-4dba-86b4-96b2f44a68d2 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:39.911565 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-e33cebb7-53da-4f4c-aff1-02aa329a2633 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:39.912185 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-6e9a2c1c-15df-4dba-86b4-96b2f44a68d2 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1315 microversion: 2.1 time: 0.961382 Aug 03 19:03:39.913397 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 53/101] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:38 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1315 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:39.930014 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [req-d4db0596-00dd-45c4-83ff-290f457bc716 req-b14c8ea2-638c-4590-911f-1e521f8178f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfa72c86-34b7-4dc4-b363-fed702f0cebd", "tag": "5fb218a1-3622-40cd-840f-fa1f0a049e67"}]} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:03:39.931428 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-e33cebb7-53da-4f4c-aff1-02aa329a2633 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1322 microversion: 2.1 time: 0.941096 Aug 03 19:03:39.933221 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 49/102] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:38 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1322 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:39.938448 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-9e38b113-4528-42e2-aa04-6da5bab240ae tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:39.939107 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-9e38b113-4528-42e2-aa04-6da5bab240ae tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:39.959579 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9e38b113-4528-42e2-aa04-6da5bab240ae tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:39.960295 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9e38b113-4528-42e2-aa04-6da5bab240ae tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:39.961791 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9e38b113-4528-42e2-aa04-6da5bab240ae tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:39.962461 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9e38b113-4528-42e2-aa04-6da5bab240ae tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:39.989993 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-d4db0596-00dd-45c4-83ff-290f457bc716 req-b14c8ea2-638c-4590-911f-1e521f8178f1 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:39.990855 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-d4db0596-00dd-45c4-83ff-290f457bc716 req-b14c8ea2-638c-4590-911f-1e521f8178f1 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:40.063648 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.compute.server_external_events [req-d4db0596-00dd-45c4-83ff-290f457bc716 req-b14c8ea2-638c-4590-911f-1e521f8178f1 service nova] Creating event network-changed:5fb218a1-3622-40cd-840f-fa1f0a049e67 for instance cfa72c86-34b7-4dc4-b363-fed702f0cebd on hv-cinder-85202 Aug 03 19:03:40.065012 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-d4db0596-00dd-45c4-83ff-290f457bc716 req-b14c8ea2-638c-4590-911f-1e521f8178f1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118303) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 03 19:03:40.067378 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-13c69829-324d-458c-b144-8b4ef10f8888 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:40.068510 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-13c69829-324d-458c-b144-8b4ef10f8888 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:40.071369 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-13c69829-324d-458c-b144-8b4ef10f8888 None None] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:40.073503 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-13c69829-324d-458c-b144-8b4ef10f8888 None None] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:40.096243 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.compute.rpcapi [None req-13c69829-324d-458c-b144-8b4ef10f8888 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 03 19:03:40.098610 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-13c69829-324d-458c-b144-8b4ef10f8888 None None] Releasing lock "compute-rpcapi-router" {{(pid=118303) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 03 19:03:40.130209 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-13c69829-324d-458c-b144-8b4ef10f8888 None None] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.210211 Aug 03 19:03:40.145916 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 54/103] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:03:40.271770 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-9e38b113-4528-42e2-aa04-6da5bab240ae tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:40.287377 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-9e38b113-4528-42e2-aa04-6da5bab240ae tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1363 microversion: 2.1 time: 0.347574 Aug 03 19:03:40.287377 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 50/104] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:39 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1363 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:40.959942 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-1e6da35e-dc1c-4be3-8070-e2cbc86a1c25 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:40.961683 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-1e6da35e-dc1c-4be3-8070-e2cbc86a1c25 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:40.964489 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-e47192e7-c36e-4cc5-bc55-ccc944da320e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:40.965569 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-e47192e7-c36e-4cc5-bc55-ccc944da320e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:40.968473 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell0:SELECT=2 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:03:40.975566 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1e6da35e-dc1c-4be3-8070-e2cbc86a1c25 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:40.976361 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1e6da35e-dc1c-4be3-8070-e2cbc86a1c25 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:40.977890 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e47192e7-c36e-4cc5-bc55-ccc944da320e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:40.978278 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e47192e7-c36e-4cc5-bc55-ccc944da320e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:40.978649 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1e6da35e-dc1c-4be3-8070-e2cbc86a1c25 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:40.979405 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e47192e7-c36e-4cc5-bc55-ccc944da320e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:40.980185 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e47192e7-c36e-4cc5-bc55-ccc944da320e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:40.980476 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1e6da35e-dc1c-4be3-8070-e2cbc86a1c25 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:41.430492 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-e47192e7-c36e-4cc5-bc55-ccc944da320e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:41.456163 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-e47192e7-c36e-4cc5-bc55-ccc944da320e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1322 microversion: 2.1 time: 0.499209 Aug 03 19:03:41.457049 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 51/105] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:40 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1322 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:41.461313 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-1e6da35e-dc1c-4be3-8070-e2cbc86a1c25 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:41.472570 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-22865bf9-4559-4354-b6e5-10dd9c028aae tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:41.473549 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-22865bf9-4559-4354-b6e5-10dd9c028aae tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:41.474995 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-1e6da35e-dc1c-4be3-8070-e2cbc86a1c25 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1315 microversion: 2.1 time: 0.521452 Aug 03 19:03:41.486765 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-22865bf9-4559-4354-b6e5-10dd9c028aae tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:41.486765 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-22865bf9-4559-4354-b6e5-10dd9c028aae tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:41.487950 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-22865bf9-4559-4354-b6e5-10dd9c028aae tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:41.488820 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-22865bf9-4559-4354-b6e5-10dd9c028aae tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:41.490769 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 55/106] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:40 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1315 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:41.769640 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-22865bf9-4559-4354-b6e5-10dd9c028aae tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:41.792522 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-22865bf9-4559-4354-b6e5-10dd9c028aae tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1363 microversion: 2.1 time: 0.333131 Aug 03 19:03:41.794458 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 52/107] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:41 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1363 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:42.493604 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-ba64cfb1-64ec-4ee2-ba74-c7ad1db52ec8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:42.495822 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-ba64cfb1-64ec-4ee2-ba74-c7ad1db52ec8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:42.513589 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ba64cfb1-64ec-4ee2-ba74-c7ad1db52ec8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:42.514486 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ba64cfb1-64ec-4ee2-ba74-c7ad1db52ec8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:42.516572 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ba64cfb1-64ec-4ee2-ba74-c7ad1db52ec8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:42.517416 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ba64cfb1-64ec-4ee2-ba74-c7ad1db52ec8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:42.518588 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-8788c1a9-876d-43fd-86c2-5edafe0157b7 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:42.519746 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-8788c1a9-876d-43fd-86c2-5edafe0157b7 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:42.534371 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8788c1a9-876d-43fd-86c2-5edafe0157b7 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:42.535747 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8788c1a9-876d-43fd-86c2-5edafe0157b7 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:42.537321 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8788c1a9-876d-43fd-86c2-5edafe0157b7 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:42.538295 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8788c1a9-876d-43fd-86c2-5edafe0157b7 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:42.902662 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-ba64cfb1-64ec-4ee2-ba74-c7ad1db52ec8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:42.919241 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-8788c1a9-876d-43fd-86c2-5edafe0157b7 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:42.934599 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-ba64cfb1-64ec-4ee2-ba74-c7ad1db52ec8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1322 microversion: 2.1 time: 0.442653 Aug 03 19:03:42.936458 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 56/108] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:42 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1322 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:42.945924 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-e9368717-647c-4ddf-b5ed-fbed64d17010 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:42.947409 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-e9368717-647c-4ddf-b5ed-fbed64d17010 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:42.962871 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-8788c1a9-876d-43fd-86c2-5edafe0157b7 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1315 microversion: 2.1 time: 0.451782 Aug 03 19:03:42.966296 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 53/109] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:42 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1315 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:42.991885 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e9368717-647c-4ddf-b5ed-fbed64d17010 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:42.998029 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e9368717-647c-4ddf-b5ed-fbed64d17010 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:42.999644 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e9368717-647c-4ddf-b5ed-fbed64d17010 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:43.001870 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e9368717-647c-4ddf-b5ed-fbed64d17010 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:43.119484 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=100 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:03:43.352150 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-e9368717-647c-4ddf-b5ed-fbed64d17010 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:43.361020 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-e9368717-647c-4ddf-b5ed-fbed64d17010 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1363 microversion: 2.1 time: 0.422648 Aug 03 19:03:43.375560 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 57/110] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:42 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1363 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:43.973081 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-bca857bf-704a-4084-9c02-54fb3f8c451c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:43.975061 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-bca857bf-704a-4084-9c02-54fb3f8c451c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:43.987657 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-bca857bf-704a-4084-9c02-54fb3f8c451c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:43.988386 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-bca857bf-704a-4084-9c02-54fb3f8c451c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:43.989754 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-bca857bf-704a-4084-9c02-54fb3f8c451c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:43.994443 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-bca857bf-704a-4084-9c02-54fb3f8c451c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:44.013073 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-3c78a8d1-459f-4461-aa69-8a3c7fe3176a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:44.014184 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-3c78a8d1-459f-4461-aa69-8a3c7fe3176a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:44.024803 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3c78a8d1-459f-4461-aa69-8a3c7fe3176a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:44.026079 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3c78a8d1-459f-4461-aa69-8a3c7fe3176a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:44.028228 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3c78a8d1-459f-4461-aa69-8a3c7fe3176a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:44.035580 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3c78a8d1-459f-4461-aa69-8a3c7fe3176a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:44.629116 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-bca857bf-704a-4084-9c02-54fb3f8c451c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:44.635922 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-3c78a8d1-459f-4461-aa69-8a3c7fe3176a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:44.645168 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-3c78a8d1-459f-4461-aa69-8a3c7fe3176a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1315 microversion: 2.1 time: 0.648313 Aug 03 19:03:44.646243 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 58/111] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:43 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1315 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:03:44.658294 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-bca857bf-704a-4084-9c02-54fb3f8c451c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1322 microversion: 2.1 time: 0.690694 Aug 03 19:03:44.662144 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-844f8f2a-cdbb-4429-ba8c-e09b944ee514 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:44.662776 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-844f8f2a-cdbb-4429-ba8c-e09b944ee514 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:44.663674 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 54/112] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:43 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1322 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:44.691945 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-844f8f2a-cdbb-4429-ba8c-e09b944ee514 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:44.692918 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-844f8f2a-cdbb-4429-ba8c-e09b944ee514 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:44.696956 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-844f8f2a-cdbb-4429-ba8c-e09b944ee514 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:44.697799 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-844f8f2a-cdbb-4429-ba8c-e09b944ee514 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:45.559146 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-844f8f2a-cdbb-4429-ba8c-e09b944ee514 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:45.596094 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-844f8f2a-cdbb-4429-ba8c-e09b944ee514 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1363 microversion: 2.1 time: 0.947972 Aug 03 19:03:45.596894 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 59/113] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:44 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1363 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:45.681696 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-a598be4d-66a8-47bc-a639-b3fb66fa0e73 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:45.683004 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-a598be4d-66a8-47bc-a639-b3fb66fa0e73 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:45.690818 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-0d91ee3a-a393-49de-a2fe-943d23c1f53e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:45.692011 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-0d91ee3a-a393-49de-a2fe-943d23c1f53e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:45.715674 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a598be4d-66a8-47bc-a639-b3fb66fa0e73 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:45.716433 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a598be4d-66a8-47bc-a639-b3fb66fa0e73 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:45.717641 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a598be4d-66a8-47bc-a639-b3fb66fa0e73 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:45.718285 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a598be4d-66a8-47bc-a639-b3fb66fa0e73 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:45.719610 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0d91ee3a-a393-49de-a2fe-943d23c1f53e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:45.720435 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0d91ee3a-a393-49de-a2fe-943d23c1f53e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:45.724310 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0d91ee3a-a393-49de-a2fe-943d23c1f53e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:45.725478 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0d91ee3a-a393-49de-a2fe-943d23c1f53e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:46.392551 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-0d91ee3a-a393-49de-a2fe-943d23c1f53e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:46.411309 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-0d91ee3a-a393-49de-a2fe-943d23c1f53e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1322 microversion: 2.1 time: 0.719980 Aug 03 19:03:46.411309 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 60/114] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:45 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1322 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:46.434030 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-a598be4d-66a8-47bc-a639-b3fb66fa0e73 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:46.446864 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=100 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:03:46.459754 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-a598be4d-66a8-47bc-a639-b3fb66fa0e73 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1315 microversion: 2.1 time: 0.792615 Aug 03 19:03:46.475612 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 55/115] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:45 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1315 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:46.643017 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-abf5cdcc-633f-4245-beec-2bfd8042cc5b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:46.644025 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-abf5cdcc-633f-4245-beec-2bfd8042cc5b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:46.656030 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-abf5cdcc-633f-4245-beec-2bfd8042cc5b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:46.656778 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-abf5cdcc-633f-4245-beec-2bfd8042cc5b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:46.658485 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-abf5cdcc-633f-4245-beec-2bfd8042cc5b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:46.659920 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-abf5cdcc-633f-4245-beec-2bfd8042cc5b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:46.959598 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-abf5cdcc-633f-4245-beec-2bfd8042cc5b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:46.976753 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-abf5cdcc-633f-4245-beec-2bfd8042cc5b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1363 microversion: 2.1 time: 0.341321 Aug 03 19:03:46.980320 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 61/116] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:46 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1363 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:03:47.440800 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-9f156717-8a50-49fd-9b24-cbb6e88f6458 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:47.441914 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-9f156717-8a50-49fd-9b24-cbb6e88f6458 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:47.453605 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9f156717-8a50-49fd-9b24-cbb6e88f6458 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:47.455554 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9f156717-8a50-49fd-9b24-cbb6e88f6458 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:47.460010 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9f156717-8a50-49fd-9b24-cbb6e88f6458 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:47.462376 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9f156717-8a50-49fd-9b24-cbb6e88f6458 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:47.504265 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-f59f6ba1-f240-44ce-b75c-c1c4c94aa9c4 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:47.505016 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-f59f6ba1-f240-44ce-b75c-c1c4c94aa9c4 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:47.516652 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f59f6ba1-f240-44ce-b75c-c1c4c94aa9c4 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:47.517130 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f59f6ba1-f240-44ce-b75c-c1c4c94aa9c4 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:47.517935 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f59f6ba1-f240-44ce-b75c-c1c4c94aa9c4 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:47.518375 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f59f6ba1-f240-44ce-b75c-c1c4c94aa9c4 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:47.876789 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-9f156717-8a50-49fd-9b24-cbb6e88f6458 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:47.881680 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-f59f6ba1-f240-44ce-b75c-c1c4c94aa9c4 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:47.897737 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-f59f6ba1-f240-44ce-b75c-c1c4c94aa9c4 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1315 microversion: 2.1 time: 0.395718 Aug 03 19:03:47.897737 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 62/117] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:47 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1315 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:47.913689 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-9f156717-8a50-49fd-9b24-cbb6e88f6458 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1322 microversion: 2.1 time: 0.478406 Aug 03 19:03:47.915908 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 56/118] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:47 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1322 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:48.016011 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-2b654d74-492d-4fb0-b2ae-5f24a4083933 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:48.017856 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-2b654d74-492d-4fb0-b2ae-5f24a4083933 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:48.036767 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2b654d74-492d-4fb0-b2ae-5f24a4083933 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:48.037562 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2b654d74-492d-4fb0-b2ae-5f24a4083933 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:48.038633 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2b654d74-492d-4fb0-b2ae-5f24a4083933 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:48.039378 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2b654d74-492d-4fb0-b2ae-5f24a4083933 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:48.291647 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-2b654d74-492d-4fb0-b2ae-5f24a4083933 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:48.315721 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-2b654d74-492d-4fb0-b2ae-5f24a4083933 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1363 microversion: 2.1 time: 0.309986 Aug 03 19:03:48.316957 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 63/119] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:48 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1363 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:48.956553 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-4d8a5036-b761-412d-929f-787b6842b343 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:48.957166 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-4d8a5036-b761-412d-929f-787b6842b343 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:48.975428 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-b3fed723-458d-40d5-955b-778cf7d7aa69 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:48.976840 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-b3fed723-458d-40d5-955b-778cf7d7aa69 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:48.983834 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4d8a5036-b761-412d-929f-787b6842b343 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:48.984996 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4d8a5036-b761-412d-929f-787b6842b343 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:48.991131 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b3fed723-458d-40d5-955b-778cf7d7aa69 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:48.992869 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4d8a5036-b761-412d-929f-787b6842b343 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:48.993663 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b3fed723-458d-40d5-955b-778cf7d7aa69 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:48.993842 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4d8a5036-b761-412d-929f-787b6842b343 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:48.996626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b3fed723-458d-40d5-955b-778cf7d7aa69 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:48.997998 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b3fed723-458d-40d5-955b-778cf7d7aa69 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:49.418740 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-b3fed723-458d-40d5-955b-778cf7d7aa69 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:49.427610 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-4d8a5036-b761-412d-929f-787b6842b343 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:49.444096 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-4d8a5036-b761-412d-929f-787b6842b343 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1315 microversion: 2.1 time: 0.491279 Aug 03 19:03:49.446208 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 57/120] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:48 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1315 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:49.456265 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-b3fed723-458d-40d5-955b-778cf7d7aa69 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1322 microversion: 2.1 time: 0.492133 Aug 03 19:03:49.458096 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 64/121] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:48 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1322 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:49.459587 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-69485cf6-b98f-4969-b374-768e7ba2eed9 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:49.460605 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-69485cf6-b98f-4969-b374-768e7ba2eed9 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:49.472396 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-69485cf6-b98f-4969-b374-768e7ba2eed9 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:49.473372 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-69485cf6-b98f-4969-b374-768e7ba2eed9 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:49.488808 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-69485cf6-b98f-4969-b374-768e7ba2eed9 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:49.489955 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-69485cf6-b98f-4969-b374-768e7ba2eed9 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:49.788713 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-69485cf6-b98f-4969-b374-768e7ba2eed9 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:49.801751 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-69485cf6-b98f-4969-b374-768e7ba2eed9 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1363 microversion: 2.1 time: 0.353512 Aug 03 19:03:49.802649 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 58/122] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:49 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1363 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:50.517687 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-215d1ba1-1e0c-48c3-8d7c-f6d20104cb89 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:50.518595 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-c520100b-5170-4747-a0ea-6a229006771a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:50.520149 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-215d1ba1-1e0c-48c3-8d7c-f6d20104cb89 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:50.520902 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-c520100b-5170-4747-a0ea-6a229006771a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:50.530003 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-215d1ba1-1e0c-48c3-8d7c-f6d20104cb89 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:50.530704 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-215d1ba1-1e0c-48c3-8d7c-f6d20104cb89 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:50.531687 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-215d1ba1-1e0c-48c3-8d7c-f6d20104cb89 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:50.532273 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-215d1ba1-1e0c-48c3-8d7c-f6d20104cb89 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:50.533060 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell0:SELECT=2 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:03:50.534706 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c520100b-5170-4747-a0ea-6a229006771a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:50.535235 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c520100b-5170-4747-a0ea-6a229006771a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:50.536212 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c520100b-5170-4747-a0ea-6a229006771a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:50.536658 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c520100b-5170-4747-a0ea-6a229006771a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:50.944762 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-c520100b-5170-4747-a0ea-6a229006771a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:50.950411 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-215d1ba1-1e0c-48c3-8d7c-f6d20104cb89 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:50.959320 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-c520100b-5170-4747-a0ea-6a229006771a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1315 microversion: 2.1 time: 0.447292 Aug 03 19:03:50.960207 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 65/123] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:50 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1315 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:50.963424 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-215d1ba1-1e0c-48c3-8d7c-f6d20104cb89 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1322 microversion: 2.1 time: 0.449737 Aug 03 19:03:50.972870 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 59/124] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:50 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1322 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:03:50.973781 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-9ce52bef-ec1d-4b95-893f-565300a51b74 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:50.974688 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-9ce52bef-ec1d-4b95-893f-565300a51b74 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:50.984914 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9ce52bef-ec1d-4b95-893f-565300a51b74 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:50.985485 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9ce52bef-ec1d-4b95-893f-565300a51b74 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:50.987029 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9ce52bef-ec1d-4b95-893f-565300a51b74 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:50.988001 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9ce52bef-ec1d-4b95-893f-565300a51b74 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:51.176897 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-9ce52bef-ec1d-4b95-893f-565300a51b74 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:51.198315 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-9ce52bef-ec1d-4b95-893f-565300a51b74 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1363 microversion: 2.1 time: 0.233666 Aug 03 19:03:51.199006 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 66/125] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:50 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:51.989674 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-3fc3d16e-571b-4818-a3c5-8869129e4856 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:51.990298 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-3fc3d16e-571b-4818-a3c5-8869129e4856 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:51.996726 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3fc3d16e-571b-4818-a3c5-8869129e4856 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:51.997187 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3fc3d16e-571b-4818-a3c5-8869129e4856 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:51.997958 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3fc3d16e-571b-4818-a3c5-8869129e4856 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:51.998399 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3fc3d16e-571b-4818-a3c5-8869129e4856 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:52.003079 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-27652441-ebfb-4176-aeba-72ffa5c7c967 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:52.004024 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-27652441-ebfb-4176-aeba-72ffa5c7c967 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:52.011981 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-27652441-ebfb-4176-aeba-72ffa5c7c967 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:52.014839 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-27652441-ebfb-4176-aeba-72ffa5c7c967 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:52.014839 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-27652441-ebfb-4176-aeba-72ffa5c7c967 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:52.014839 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-27652441-ebfb-4176-aeba-72ffa5c7c967 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:52.252078 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-3fc3d16e-571b-4818-a3c5-8869129e4856 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:52.266177 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-3fc3d16e-571b-4818-a3c5-8869129e4856 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1315 microversion: 2.1 time: 0.280490 Aug 03 19:03:52.266998 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 60/126] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:51 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:03:52.280690 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-ad80cc05-d5ba-4d57-a25e-7560d30f6f35 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:52.281618 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-ad80cc05-d5ba-4d57-a25e-7560d30f6f35 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:52.286872 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-27652441-ebfb-4176-aeba-72ffa5c7c967 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:52.290215 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ad80cc05-d5ba-4d57-a25e-7560d30f6f35 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:52.290707 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ad80cc05-d5ba-4d57-a25e-7560d30f6f35 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:52.291938 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ad80cc05-d5ba-4d57-a25e-7560d30f6f35 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:52.292509 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ad80cc05-d5ba-4d57-a25e-7560d30f6f35 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:52.300568 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-27652441-ebfb-4176-aeba-72ffa5c7c967 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1322 microversion: 2.1 time: 0.301714 Aug 03 19:03:52.305645 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 67/127] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:51 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1322 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:52.477707 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-ad80cc05-d5ba-4d57-a25e-7560d30f6f35 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:52.487784 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-ad80cc05-d5ba-4d57-a25e-7560d30f6f35 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1363 microversion: 2.1 time: 0.215167 Aug 03 19:03:52.488906 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 61/128] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:52 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:53.290003 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-1f8a47a9-3442-4d15-9def-fd48b1067b7b tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:53.291282 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-1f8a47a9-3442-4d15-9def-fd48b1067b7b tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:53.300635 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1f8a47a9-3442-4d15-9def-fd48b1067b7b tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:53.301383 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1f8a47a9-3442-4d15-9def-fd48b1067b7b tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:53.302656 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1f8a47a9-3442-4d15-9def-fd48b1067b7b tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:53.303615 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1f8a47a9-3442-4d15-9def-fd48b1067b7b tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:53.333547 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-605e16a0-29fa-4324-b50a-3241e4239912 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:53.343500 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-605e16a0-29fa-4324-b50a-3241e4239912 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:53.345360 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-605e16a0-29fa-4324-b50a-3241e4239912 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:53.348179 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-605e16a0-29fa-4324-b50a-3241e4239912 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:53.349143 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-605e16a0-29fa-4324-b50a-3241e4239912 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:53.349807 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-605e16a0-29fa-4324-b50a-3241e4239912 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:53.811607 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-1f8a47a9-3442-4d15-9def-fd48b1067b7b tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:53.820802 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-1f8a47a9-3442-4d15-9def-fd48b1067b7b tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1315 microversion: 2.1 time: 0.535469 Aug 03 19:03:53.821666 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 68/129] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:53 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1315 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:53.826703 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-605e16a0-29fa-4324-b50a-3241e4239912 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:53.829824 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-3465b92c-65a9-4a10-932e-3d0000078628 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:53.831364 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-3465b92c-65a9-4a10-932e-3d0000078628 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:53.840847 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3465b92c-65a9-4a10-932e-3d0000078628 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:53.841788 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3465b92c-65a9-4a10-932e-3d0000078628 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:53.843666 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3465b92c-65a9-4a10-932e-3d0000078628 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:53.843980 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-605e16a0-29fa-4324-b50a-3241e4239912 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1322 microversion: 2.1 time: 0.516966 Aug 03 19:03:53.844336 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3465b92c-65a9-4a10-932e-3d0000078628 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:53.844795 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 62/130] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:53 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1322 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:03:54.060955 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-3465b92c-65a9-4a10-932e-3d0000078628 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:54.070976 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-3465b92c-65a9-4a10-932e-3d0000078628 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1363 microversion: 2.1 time: 0.247818 Aug 03 19:03:54.071780 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 69/131] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:53 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:54.846162 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-d5595640-2e3a-4da9-9868-bb5b2a7e9e9a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:54.846901 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-d5595640-2e3a-4da9-9868-bb5b2a7e9e9a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:54.853527 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d5595640-2e3a-4da9-9868-bb5b2a7e9e9a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:54.854155 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d5595640-2e3a-4da9-9868-bb5b2a7e9e9a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:54.855094 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d5595640-2e3a-4da9-9868-bb5b2a7e9e9a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:54.855609 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d5595640-2e3a-4da9-9868-bb5b2a7e9e9a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:54.881849 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-ca62531a-4a50-4505-9ec8-1e4750662c7b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:54.883755 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-ca62531a-4a50-4505-9ec8-1e4750662c7b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:54.894715 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ca62531a-4a50-4505-9ec8-1e4750662c7b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:54.895467 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ca62531a-4a50-4505-9ec8-1e4750662c7b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:54.896655 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ca62531a-4a50-4505-9ec8-1e4750662c7b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:54.897364 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ca62531a-4a50-4505-9ec8-1e4750662c7b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:55.174709 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-d5595640-2e3a-4da9-9868-bb5b2a7e9e9a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:55.183985 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-ca62531a-4a50-4505-9ec8-1e4750662c7b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:55.189955 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-d5595640-2e3a-4da9-9868-bb5b2a7e9e9a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1315 microversion: 2.1 time: 0.347568 Aug 03 19:03:55.195374 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 63/132] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:54 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:55.199227 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-ca62531a-4a50-4505-9ec8-1e4750662c7b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1322 microversion: 2.1 time: 0.323070 Aug 03 19:03:55.199829 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-0c58f002-8d94-4ddc-8e1d-5eab4d79e8f2 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:55.200726 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-0c58f002-8d94-4ddc-8e1d-5eab4d79e8f2 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:55.210821 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0c58f002-8d94-4ddc-8e1d-5eab4d79e8f2 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:55.211612 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0c58f002-8d94-4ddc-8e1d-5eab4d79e8f2 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:55.212585 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 70/133] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:54 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1322 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:03:55.214719 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0c58f002-8d94-4ddc-8e1d-5eab4d79e8f2 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:55.214719 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0c58f002-8d94-4ddc-8e1d-5eab4d79e8f2 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:55.440717 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-0c58f002-8d94-4ddc-8e1d-5eab4d79e8f2 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:55.450554 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-0c58f002-8d94-4ddc-8e1d-5eab4d79e8f2 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1363 microversion: 2.1 time: 0.257647 Aug 03 19:03:55.451176 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 64/134] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:55 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1363 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:56.223689 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-cb8c134b-e6ec-4da3-b62f-191dda5ab98f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:56.224716 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-cb8c134b-e6ec-4da3-b62f-191dda5ab98f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:56.231586 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cb8c134b-e6ec-4da3-b62f-191dda5ab98f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:56.232029 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cb8c134b-e6ec-4da3-b62f-191dda5ab98f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:56.232842 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cb8c134b-e6ec-4da3-b62f-191dda5ab98f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:56.233394 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cb8c134b-e6ec-4da3-b62f-191dda5ab98f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:56.238641 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-7529c1a2-37b3-4117-bf3f-d65b9bdc2484 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:56.239741 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-7529c1a2-37b3-4117-bf3f-d65b9bdc2484 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:56.248783 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7529c1a2-37b3-4117-bf3f-d65b9bdc2484 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:56.249445 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7529c1a2-37b3-4117-bf3f-d65b9bdc2484 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:56.250654 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7529c1a2-37b3-4117-bf3f-d65b9bdc2484 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:56.251602 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7529c1a2-37b3-4117-bf3f-d65b9bdc2484 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:56.529145 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-cb8c134b-e6ec-4da3-b62f-191dda5ab98f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:56.537778 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-cb8c134b-e6ec-4da3-b62f-191dda5ab98f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1322 microversion: 2.1 time: 0.318253 Aug 03 19:03:56.538689 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 71/135] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:56 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1322 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:56.545125 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-7f4f2aad-0213-4c31-a4be-989cb298d302 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:56.545734 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-7f4f2aad-0213-4c31-a4be-989cb298d302 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:56.552657 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-7f4f2aad-0213-4c31-a4be-989cb298d302 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:56.553012 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-7f4f2aad-0213-4c31-a4be-989cb298d302 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:56.553952 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-7f4f2aad-0213-4c31-a4be-989cb298d302 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:56.554537 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-7f4f2aad-0213-4c31-a4be-989cb298d302 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:56.576680 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-7529c1a2-37b3-4117-bf3f-d65b9bdc2484 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:56.586547 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-7529c1a2-37b3-4117-bf3f-d65b9bdc2484 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1315 microversion: 2.1 time: 0.354005 Aug 03 19:03:56.587489 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 65/136] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:56 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:56.722729 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-7f4f2aad-0213-4c31-a4be-989cb298d302 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:56.731578 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-7f4f2aad-0213-4c31-a4be-989cb298d302 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1363 microversion: 2.1 time: 0.191787 Aug 03 19:03:56.732158 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 72/137] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:56 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:57.570251 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-67a9ea47-ab63-401f-84ee-8ecef69754e3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:57.575120 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-67a9ea47-ab63-401f-84ee-8ecef69754e3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:57.577914 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-67a9ea47-ab63-401f-84ee-8ecef69754e3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:57.578369 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-67a9ea47-ab63-401f-84ee-8ecef69754e3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:57.579178 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-67a9ea47-ab63-401f-84ee-8ecef69754e3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:57.579613 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-67a9ea47-ab63-401f-84ee-8ecef69754e3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:57.614386 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-31db7c69-4160-46c4-971e-d0ceb6424b23 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:57.614386 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-31db7c69-4160-46c4-971e-d0ceb6424b23 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:57.627151 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-31db7c69-4160-46c4-971e-d0ceb6424b23 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:57.628102 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-31db7c69-4160-46c4-971e-d0ceb6424b23 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:57.629998 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-31db7c69-4160-46c4-971e-d0ceb6424b23 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:57.631212 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-31db7c69-4160-46c4-971e-d0ceb6424b23 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:57.827467 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-67a9ea47-ab63-401f-84ee-8ecef69754e3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:57.835776 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-67a9ea47-ab63-401f-84ee-8ecef69754e3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1322 microversion: 2.1 time: 0.271321 Aug 03 19:03:57.845987 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 66/138] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:57 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:57.845987 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-0ee0554b-9915-4949-9583-b78ebb772218 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:57.845987 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-0ee0554b-9915-4949-9583-b78ebb772218 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:57.852570 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0ee0554b-9915-4949-9583-b78ebb772218 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:57.853398 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0ee0554b-9915-4949-9583-b78ebb772218 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:57.854249 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0ee0554b-9915-4949-9583-b78ebb772218 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:57.854839 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0ee0554b-9915-4949-9583-b78ebb772218 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:57.868196 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-31db7c69-4160-46c4-971e-d0ceb6424b23 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:57.876430 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=100 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:03:57.881789 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-31db7c69-4160-46c4-971e-d0ceb6424b23 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1315 microversion: 2.1 time: 0.278215 Aug 03 19:03:57.882427 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 73/139] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:57 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:58.018999 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-0ee0554b-9915-4949-9583-b78ebb772218 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:58.027071 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-0ee0554b-9915-4949-9583-b78ebb772218 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1363 microversion: 2.1 time: 0.189421 Aug 03 19:03:58.027839 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 67/140] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:57 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:58.870557 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-d74dafef-ceef-46b8-8541-5a20bdce238a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:58.871579 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-d74dafef-ceef-46b8-8541-5a20bdce238a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:58.878551 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d74dafef-ceef-46b8-8541-5a20bdce238a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:58.879041 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d74dafef-ceef-46b8-8541-5a20bdce238a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:58.879817 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d74dafef-ceef-46b8-8541-5a20bdce238a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:58.880292 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d74dafef-ceef-46b8-8541-5a20bdce238a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:58.909348 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-43d30dd5-6bd9-481b-a161-f7112cddc5bb tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:58.910275 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-43d30dd5-6bd9-481b-a161-f7112cddc5bb tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:58.920790 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-43d30dd5-6bd9-481b-a161-f7112cddc5bb tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:58.921541 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-43d30dd5-6bd9-481b-a161-f7112cddc5bb tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:58.922865 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-43d30dd5-6bd9-481b-a161-f7112cddc5bb tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:58.923684 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-43d30dd5-6bd9-481b-a161-f7112cddc5bb tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:59.179520 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-d74dafef-ceef-46b8-8541-5a20bdce238a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:59.188089 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-d74dafef-ceef-46b8-8541-5a20bdce238a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1322 microversion: 2.1 time: 0.324922 Aug 03 19:03:59.188700 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 74/141] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:58 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1322 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:59.194564 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-be5235dd-544b-4018-ae6c-19a6b030ae0d tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:59.195432 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-be5235dd-544b-4018-ae6c-19a6b030ae0d tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:59.209944 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-43d30dd5-6bd9-481b-a161-f7112cddc5bb tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:59.212910 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-be5235dd-544b-4018-ae6c-19a6b030ae0d tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:59.213749 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-be5235dd-544b-4018-ae6c-19a6b030ae0d tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:59.215352 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-be5235dd-544b-4018-ae6c-19a6b030ae0d tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:59.216125 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-be5235dd-544b-4018-ae6c-19a6b030ae0d tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:59.218227 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-43d30dd5-6bd9-481b-a161-f7112cddc5bb tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1315 microversion: 2.1 time: 0.316080 Aug 03 19:03:59.219117 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 68/142] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:58 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:03:59.449779 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-be5235dd-544b-4018-ae6c-19a6b030ae0d tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:03:59.457936 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-be5235dd-544b-4018-ae6c-19a6b030ae0d tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1363 microversion: 2.1 time: 0.268064 Aug 03 19:03:59.458613 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 75/143] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:03:59 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1363 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:00.104114 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-c63e3f4f-b3a9-4487-9d3f-8d32dd674b65 req-aa716aaa-4f78-4cdd-bb4b-32fc9de604ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82aa6775-8d66-4d67-af69-104454485a2a", "name": "network-vif-plugged", "status": "completed", "tag": "1932c7bb-4cf4-4b3d-af32-ca8b71b79229"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:04:00.129281 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-c63e3f4f-b3a9-4487-9d3f-8d32dd674b65 req-aa716aaa-4f78-4cdd-bb4b-32fc9de604ce service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:00.129639 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-c63e3f4f-b3a9-4487-9d3f-8d32dd674b65 req-aa716aaa-4f78-4cdd-bb4b-32fc9de604ce service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:00.145716 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-c63e3f4f-b3a9-4487-9d3f-8d32dd674b65 req-aa716aaa-4f78-4cdd-bb4b-32fc9de604ce service nova] Creating event network-vif-plugged:1932c7bb-4cf4-4b3d-af32-ca8b71b79229 for instance 82aa6775-8d66-4d67-af69-104454485a2a on hv-cinder-85202 Aug 03 19:04:00.152086 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-c63e3f4f-b3a9-4487-9d3f-8d32dd674b65 req-aa716aaa-4f78-4cdd-bb4b-32fc9de604ce service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.277608 Aug 03 19:04:00.153317 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 69/144] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:04:00.224409 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-eb7c57ed-e8d7-487d-9f0d-3210d3e341f8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:00.224872 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-eb7c57ed-e8d7-487d-9f0d-3210d3e341f8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:00.234103 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-eb7c57ed-e8d7-487d-9f0d-3210d3e341f8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:00.235201 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-eb7c57ed-e8d7-487d-9f0d-3210d3e341f8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:00.236623 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-eb7c57ed-e8d7-487d-9f0d-3210d3e341f8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:00.242179 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-e895f5f4-2b8c-4779-b865-8a46d059f938 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:00.243366 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-e895f5f4-2b8c-4779-b865-8a46d059f938 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:00.250059 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-eb7c57ed-e8d7-487d-9f0d-3210d3e341f8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:00.252734 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e895f5f4-2b8c-4779-b865-8a46d059f938 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:00.253496 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e895f5f4-2b8c-4779-b865-8a46d059f938 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:00.254471 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e895f5f4-2b8c-4779-b865-8a46d059f938 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:00.255152 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e895f5f4-2b8c-4779-b865-8a46d059f938 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:00.583363 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-eb7c57ed-e8d7-487d-9f0d-3210d3e341f8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:00.599917 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-e895f5f4-2b8c-4779-b865-8a46d059f938 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:00.601101 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-eb7c57ed-e8d7-487d-9f0d-3210d3e341f8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1322 microversion: 2.1 time: 0.382778 Aug 03 19:04:00.603513 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 76/145] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:00 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1322 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:04:00.612469 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-463aa828-4bb4-48d9-a704-db94dd876eed tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:00.613064 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-463aa828-4bb4-48d9-a704-db94dd876eed tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:00.620495 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-e895f5f4-2b8c-4779-b865-8a46d059f938 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1315 microversion: 2.1 time: 0.382866 Aug 03 19:04:00.622811 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 70/146] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:00 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:00.634387 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-463aa828-4bb4-48d9-a704-db94dd876eed tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:00.634840 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-463aa828-4bb4-48d9-a704-db94dd876eed tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:00.638233 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-463aa828-4bb4-48d9-a704-db94dd876eed tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:00.638233 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-463aa828-4bb4-48d9-a704-db94dd876eed tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:01.004416 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-463aa828-4bb4-48d9-a704-db94dd876eed tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:01.021282 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-463aa828-4bb4-48d9-a704-db94dd876eed tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1363 microversion: 2.1 time: 0.414894 Aug 03 19:04:01.022800 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 77/147] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:00 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1363 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:01.628221 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-70883af8-f9ee-4917-829e-d25d3c75f329 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:01.628779 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-70883af8-f9ee-4917-829e-d25d3c75f329 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:01.634743 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-70883af8-f9ee-4917-829e-d25d3c75f329 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:01.635839 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-70883af8-f9ee-4917-829e-d25d3c75f329 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:01.636893 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-70883af8-f9ee-4917-829e-d25d3c75f329 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:01.637337 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-70883af8-f9ee-4917-829e-d25d3c75f329 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:01.658846 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-317be117-a89c-471c-900b-d0de3bde39d6 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:01.659629 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-317be117-a89c-471c-900b-d0de3bde39d6 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:01.670740 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-317be117-a89c-471c-900b-d0de3bde39d6 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:01.671995 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-317be117-a89c-471c-900b-d0de3bde39d6 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:01.673859 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-317be117-a89c-471c-900b-d0de3bde39d6 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:01.677252 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-317be117-a89c-471c-900b-d0de3bde39d6 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:01.964848 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-70883af8-f9ee-4917-829e-d25d3c75f329 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:01.975223 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-70883af8-f9ee-4917-829e-d25d3c75f329 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1322 microversion: 2.1 time: 0.351292 Aug 03 19:04:01.976142 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 71/148] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:01 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1322 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:04:02.023042 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-317be117-a89c-471c-900b-d0de3bde39d6 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:02.044385 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-317be117-a89c-471c-900b-d0de3bde39d6 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1315 microversion: 2.1 time: 0.390141 Aug 03 19:04:02.046313 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 78/149] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:01 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:02.049901 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-b1cd1b1f-1729-496d-89c8-4db4b7fde4f3 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:02.051062 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-b1cd1b1f-1729-496d-89c8-4db4b7fde4f3 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:02.063576 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b1cd1b1f-1729-496d-89c8-4db4b7fde4f3 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:02.064369 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b1cd1b1f-1729-496d-89c8-4db4b7fde4f3 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:02.065999 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b1cd1b1f-1729-496d-89c8-4db4b7fde4f3 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:02.066777 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b1cd1b1f-1729-496d-89c8-4db4b7fde4f3 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:02.312705 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-b1cd1b1f-1729-496d-89c8-4db4b7fde4f3 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:02.330636 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-b1cd1b1f-1729-496d-89c8-4db4b7fde4f3 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1363 microversion: 2.1 time: 0.287184 Aug 03 19:04:02.332021 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 72/150] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:02 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1363 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:03.002503 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-3e5e21b4-dd8d-4d45-87cf-c21e567b8b77 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:03.003563 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-3e5e21b4-dd8d-4d45-87cf-c21e567b8b77 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:03.013003 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3e5e21b4-dd8d-4d45-87cf-c21e567b8b77 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:03.013675 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3e5e21b4-dd8d-4d45-87cf-c21e567b8b77 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:03.014912 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3e5e21b4-dd8d-4d45-87cf-c21e567b8b77 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:03.015729 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3e5e21b4-dd8d-4d45-87cf-c21e567b8b77 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:03.080038 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-b973fd47-063f-4fc2-84b7-36c5a95059f2 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:03.080736 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-b973fd47-063f-4fc2-84b7-36c5a95059f2 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:03.087525 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b973fd47-063f-4fc2-84b7-36c5a95059f2 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:03.087980 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b973fd47-063f-4fc2-84b7-36c5a95059f2 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:03.089375 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b973fd47-063f-4fc2-84b7-36c5a95059f2 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:03.089825 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b973fd47-063f-4fc2-84b7-36c5a95059f2 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:03.094935 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=100 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:04:03.315782 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-3e5e21b4-dd8d-4d45-87cf-c21e567b8b77 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:03.328848 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-3e5e21b4-dd8d-4d45-87cf-c21e567b8b77 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1322 microversion: 2.1 time: 0.331138 Aug 03 19:04:03.328848 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 79/151] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:02 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1322 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:04:03.366866 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-b295933f-357f-4821-8ad3-a99c1c2e149b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:03.367818 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-b295933f-357f-4821-8ad3-a99c1c2e149b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:03.397509 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b295933f-357f-4821-8ad3-a99c1c2e149b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:03.397509 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b295933f-357f-4821-8ad3-a99c1c2e149b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:03.397509 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b295933f-357f-4821-8ad3-a99c1c2e149b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:03.397509 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b295933f-357f-4821-8ad3-a99c1c2e149b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:03.478431 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-b973fd47-063f-4fc2-84b7-36c5a95059f2 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:03.502542 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-b973fd47-063f-4fc2-84b7-36c5a95059f2 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1315 microversion: 2.1 time: 0.426415 Aug 03 19:04:03.504682 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 73/152] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:03 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1315 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:03.640512 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-b295933f-357f-4821-8ad3-a99c1c2e149b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:03.678515 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-b295933f-357f-4821-8ad3-a99c1c2e149b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1363 microversion: 2.1 time: 0.311229 Aug 03 19:04:03.680915 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 80/153] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:03 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1363 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:04:03.917352 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-84bbddcd-4c16-43a6-b10e-615efeb41eb9 req-34ad15a7-b70f-4293-af0a-8f679bf108a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "272088aa-31e7-465f-a224-b49f3a86497c", "name": "network-vif-plugged", "status": "completed", "tag": "77e656cc-d42d-42c8-bbff-4d87ddc50476"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:04:03.933033 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-84bbddcd-4c16-43a6-b10e-615efeb41eb9 req-34ad15a7-b70f-4293-af0a-8f679bf108a8 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:03.934792 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-84bbddcd-4c16-43a6-b10e-615efeb41eb9 req-34ad15a7-b70f-4293-af0a-8f679bf108a8 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:03.951421 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-84bbddcd-4c16-43a6-b10e-615efeb41eb9 req-34ad15a7-b70f-4293-af0a-8f679bf108a8 service nova] Creating event network-vif-plugged:77e656cc-d42d-42c8-bbff-4d87ddc50476 for instance 272088aa-31e7-465f-a224-b49f3a86497c on hv-cinder-85202 Aug 03 19:04:03.961611 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-84bbddcd-4c16-43a6-b10e-615efeb41eb9 req-34ad15a7-b70f-4293-af0a-8f679bf108a8 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048640 Aug 03 19:04:03.962865 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 74/154] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 19:04:04.356709 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-c1784349-7096-4a48-983f-3cdd1be71053 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:04.357336 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-c1784349-7096-4a48-983f-3cdd1be71053 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:04.359267 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_api:SELECT=63 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:04:04.367362 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c1784349-7096-4a48-983f-3cdd1be71053 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:04.368472 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c1784349-7096-4a48-983f-3cdd1be71053 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:04.369486 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c1784349-7096-4a48-983f-3cdd1be71053 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:04.370121 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c1784349-7096-4a48-983f-3cdd1be71053 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:04.539409 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-7021b088-776b-42b4-af4e-a39c2a1f9755 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:04.542639 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-7021b088-776b-42b4-af4e-a39c2a1f9755 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:04.545983 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_api:SELECT=61 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:04:04.554489 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7021b088-776b-42b4-af4e-a39c2a1f9755 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:04.555789 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7021b088-776b-42b4-af4e-a39c2a1f9755 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:04.559087 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7021b088-776b-42b4-af4e-a39c2a1f9755 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:04.560860 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7021b088-776b-42b4-af4e-a39c2a1f9755 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:04.565183 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-c1784349-7096-4a48-983f-3cdd1be71053 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:04.585271 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-c1784349-7096-4a48-983f-3cdd1be71053 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1322 microversion: 2.1 time: 0.232648 Aug 03 19:04:04.598888 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 81/155] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:04 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:04.709237 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-d85f6f68-fcbc-4f5c-8082-ba4b81ab7992 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:04.710780 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-d85f6f68-fcbc-4f5c-8082-ba4b81ab7992 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:04.718613 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d85f6f68-fcbc-4f5c-8082-ba4b81ab7992 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:04.722975 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d85f6f68-fcbc-4f5c-8082-ba4b81ab7992 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:04.722975 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d85f6f68-fcbc-4f5c-8082-ba4b81ab7992 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:04.722975 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d85f6f68-fcbc-4f5c-8082-ba4b81ab7992 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:04.847453 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-7021b088-776b-42b4-af4e-a39c2a1f9755 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:04.868189 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-7021b088-776b-42b4-af4e-a39c2a1f9755 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1315 microversion: 2.1 time: 0.336285 Aug 03 19:04:04.870458 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 75/156] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:04 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1315 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:04:04.933240 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-d85f6f68-fcbc-4f5c-8082-ba4b81ab7992 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:04.941260 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-d85f6f68-fcbc-4f5c-8082-ba4b81ab7992 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1363 microversion: 2.1 time: 0.238750 Aug 03 19:04:04.942158 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 82/157] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:04 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:04:05.613235 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-6fcab664-54d3-484f-8a30-fbabc811e6fc tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:05.614055 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-6fcab664-54d3-484f-8a30-fbabc811e6fc tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:05.653471 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-6fcab664-54d3-484f-8a30-fbabc811e6fc tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:05.654970 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-6fcab664-54d3-484f-8a30-fbabc811e6fc tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:05.658926 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-6fcab664-54d3-484f-8a30-fbabc811e6fc tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:05.659717 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-6fcab664-54d3-484f-8a30-fbabc811e6fc tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:05.855770 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-6fcab664-54d3-484f-8a30-fbabc811e6fc tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:05.880942 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-6fcab664-54d3-484f-8a30-fbabc811e6fc tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1322 microversion: 2.1 time: 0.276913 Aug 03 19:04:05.882296 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 76/158] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:05 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1322 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:05.913616 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-d9b2f6ba-4d93-49af-9fea-cc66b4ab8946 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:05.913616 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-d9b2f6ba-4d93-49af-9fea-cc66b4ab8946 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:05.925805 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d9b2f6ba-4d93-49af-9fea-cc66b4ab8946 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:05.926751 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d9b2f6ba-4d93-49af-9fea-cc66b4ab8946 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:05.927820 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d9b2f6ba-4d93-49af-9fea-cc66b4ab8946 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:05.928484 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d9b2f6ba-4d93-49af-9fea-cc66b4ab8946 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:05.993316 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-f0aad912-d442-49f2-b602-79654b22c8c2 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:05.993939 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-f0aad912-d442-49f2-b602-79654b22c8c2 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:06.023020 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f0aad912-d442-49f2-b602-79654b22c8c2 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:06.023698 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f0aad912-d442-49f2-b602-79654b22c8c2 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:06.024904 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f0aad912-d442-49f2-b602-79654b22c8c2 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:06.025553 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f0aad912-d442-49f2-b602-79654b22c8c2 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:06.180492 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-d9b2f6ba-4d93-49af-9fea-cc66b4ab8946 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:06.191202 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-d9b2f6ba-4d93-49af-9fea-cc66b4ab8946 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1315 microversion: 2.1 time: 0.294100 Aug 03 19:04:06.191850 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 83/159] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:05 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:04:06.250181 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-f0aad912-d442-49f2-b602-79654b22c8c2 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:06.264871 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-f0aad912-d442-49f2-b602-79654b22c8c2 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1363 microversion: 2.1 time: 0.280260 Aug 03 19:04:06.276229 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 77/160] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:05 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1363 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:04:06.916610 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-28f3c7ef-a662-43f8-83e7-7fe617870a54 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:06.917932 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-28f3c7ef-a662-43f8-83e7-7fe617870a54 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:06.926415 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-28f3c7ef-a662-43f8-83e7-7fe617870a54 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:06.926939 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-28f3c7ef-a662-43f8-83e7-7fe617870a54 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:06.927764 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-28f3c7ef-a662-43f8-83e7-7fe617870a54 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:06.928202 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-28f3c7ef-a662-43f8-83e7-7fe617870a54 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:07.160439 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-28f3c7ef-a662-43f8-83e7-7fe617870a54 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:07.174084 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-28f3c7ef-a662-43f8-83e7-7fe617870a54 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1322 microversion: 2.1 time: 0.268399 Aug 03 19:04:07.175296 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 84/161] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:06 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:07.217422 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-f6f50cf2-08b7-467d-9b0e-cdccc7112f01 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:07.222369 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-f6f50cf2-08b7-467d-9b0e-cdccc7112f01 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:07.229974 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f6f50cf2-08b7-467d-9b0e-cdccc7112f01 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:07.230529 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f6f50cf2-08b7-467d-9b0e-cdccc7112f01 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:07.231591 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f6f50cf2-08b7-467d-9b0e-cdccc7112f01 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:07.232318 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f6f50cf2-08b7-467d-9b0e-cdccc7112f01 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:07.317958 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-4e00f9f7-3f12-499a-8f3c-a8dd1f13e38f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:07.319252 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-4e00f9f7-3f12-499a-8f3c-a8dd1f13e38f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:07.331337 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4e00f9f7-3f12-499a-8f3c-a8dd1f13e38f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:07.332471 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4e00f9f7-3f12-499a-8f3c-a8dd1f13e38f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:07.334066 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4e00f9f7-3f12-499a-8f3c-a8dd1f13e38f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:07.334903 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4e00f9f7-3f12-499a-8f3c-a8dd1f13e38f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:07.568404 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-f6f50cf2-08b7-467d-9b0e-cdccc7112f01 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:07.587094 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-f6f50cf2-08b7-467d-9b0e-cdccc7112f01 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1315 microversion: 2.1 time: 0.377734 Aug 03 19:04:07.588644 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 78/162] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:07 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:07.669651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-4e00f9f7-3f12-499a-8f3c-a8dd1f13e38f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:07.682801 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-4e00f9f7-3f12-499a-8f3c-a8dd1f13e38f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1363 microversion: 2.1 time: 0.370400 Aug 03 19:04:07.684732 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 85/163] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:07 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1363 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:04:07.898147 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-e0ffb68b-9390-42a8-856e-a85d3d230f95 req-c017e9e5-58cf-4225-b75d-b363ca084eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54ad07ab-f23e-4369-8940-65095533457d", "name": "network-vif-plugged", "status": "completed", "tag": "14f5d67f-5c4d-441e-993c-111e289fd40a"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:04:07.912466 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-e0ffb68b-9390-42a8-856e-a85d3d230f95 req-c017e9e5-58cf-4225-b75d-b363ca084eb7 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:07.912466 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-e0ffb68b-9390-42a8-856e-a85d3d230f95 req-c017e9e5-58cf-4225-b75d-b363ca084eb7 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:07.934515 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-e0ffb68b-9390-42a8-856e-a85d3d230f95 req-c017e9e5-58cf-4225-b75d-b363ca084eb7 service nova] Creating event network-vif-plugged:14f5d67f-5c4d-441e-993c-111e289fd40a for instance 54ad07ab-f23e-4369-8940-65095533457d on hv-cinder-85202 Aug 03 19:04:07.941193 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-e0ffb68b-9390-42a8-856e-a85d3d230f95 req-c017e9e5-58cf-4225-b75d-b363ca084eb7 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047880 Aug 03 19:04:07.942197 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 79/164] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 19:04:08.209698 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-2c692cdb-a737-47bd-b3c9-89736c21aa26 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:08.211742 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-2c692cdb-a737-47bd-b3c9-89736c21aa26 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:08.229054 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2c692cdb-a737-47bd-b3c9-89736c21aa26 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:08.246076 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2c692cdb-a737-47bd-b3c9-89736c21aa26 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:08.248195 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2c692cdb-a737-47bd-b3c9-89736c21aa26 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:08.249096 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2c692cdb-a737-47bd-b3c9-89736c21aa26 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:08.523835 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-2c692cdb-a737-47bd-b3c9-89736c21aa26 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:08.545880 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-2c692cdb-a737-47bd-b3c9-89736c21aa26 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1322 microversion: 2.1 time: 0.341485 Aug 03 19:04:08.562318 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 86/165] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:08 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1322 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:08.611597 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-ee5ede45-9774-4750-b218-96dc9ec33dc5 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:08.612326 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-ee5ede45-9774-4750-b218-96dc9ec33dc5 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:08.626135 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ee5ede45-9774-4750-b218-96dc9ec33dc5 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:08.631829 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ee5ede45-9774-4750-b218-96dc9ec33dc5 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:08.634309 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ee5ede45-9774-4750-b218-96dc9ec33dc5 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:08.635170 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ee5ede45-9774-4750-b218-96dc9ec33dc5 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:08.712146 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-74ed1def-4e90-40df-97c9-688a2ce8512c tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:08.712800 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-74ed1def-4e90-40df-97c9-688a2ce8512c tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:08.731087 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-74ed1def-4e90-40df-97c9-688a2ce8512c tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:08.740656 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-74ed1def-4e90-40df-97c9-688a2ce8512c tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:08.752632 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-74ed1def-4e90-40df-97c9-688a2ce8512c tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:08.755784 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-74ed1def-4e90-40df-97c9-688a2ce8512c tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:09.185122 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-ee5ede45-9774-4750-b218-96dc9ec33dc5 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:09.203811 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-ee5ede45-9774-4750-b218-96dc9ec33dc5 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1315 microversion: 2.1 time: 0.596566 Aug 03 19:04:09.204732 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-74ed1def-4e90-40df-97c9-688a2ce8512c tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:09.207778 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 80/166] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:08 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1315 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:09.219577 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-74ed1def-4e90-40df-97c9-688a2ce8512c tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1363 microversion: 2.1 time: 0.511137 Aug 03 19:04:09.220628 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 87/167] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:08 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1363 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:09.578722 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-11e336db-86ab-438d-b4cf-d87c262df87d tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:09.579500 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-11e336db-86ab-438d-b4cf-d87c262df87d tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:09.601521 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-11e336db-86ab-438d-b4cf-d87c262df87d tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:09.602039 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-11e336db-86ab-438d-b4cf-d87c262df87d tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:09.602871 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-11e336db-86ab-438d-b4cf-d87c262df87d tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:09.603337 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-11e336db-86ab-438d-b4cf-d87c262df87d tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:09.841492 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-11e336db-86ab-438d-b4cf-d87c262df87d tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:09.880136 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-11e336db-86ab-438d-b4cf-d87c262df87d tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1322 microversion: 2.1 time: 0.307360 Aug 03 19:04:09.884098 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 81/168] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:09 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1322 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:10.238012 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-26d5f567-369d-4c38-9568-b3c70319d39c tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:10.240275 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-26d5f567-369d-4c38-9568-b3c70319d39c tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:10.251569 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-d274448d-47aa-4d73-9f4d-626e78ca72bc tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:10.255597 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-d274448d-47aa-4d73-9f4d-626e78ca72bc tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:10.272539 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-26d5f567-369d-4c38-9568-b3c70319d39c tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:10.273001 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d274448d-47aa-4d73-9f4d-626e78ca72bc tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:10.273270 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-26d5f567-369d-4c38-9568-b3c70319d39c tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:10.274334 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d274448d-47aa-4d73-9f4d-626e78ca72bc tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:10.274662 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-26d5f567-369d-4c38-9568-b3c70319d39c tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:10.276652 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-26d5f567-369d-4c38-9568-b3c70319d39c tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:10.276873 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d274448d-47aa-4d73-9f4d-626e78ca72bc tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:10.278167 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d274448d-47aa-4d73-9f4d-626e78ca72bc tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:10.567445 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-26d5f567-369d-4c38-9568-b3c70319d39c tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:10.574011 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-d274448d-47aa-4d73-9f4d-626e78ca72bc tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:10.584526 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-26d5f567-369d-4c38-9568-b3c70319d39c tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1315 microversion: 2.1 time: 0.357102 Aug 03 19:04:10.597764 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-d274448d-47aa-4d73-9f4d-626e78ca72bc tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1363 microversion: 2.1 time: 0.352158 Aug 03 19:04:10.602603 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 82/169] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:10 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1363 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:04:10.611094 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 88/170] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:10 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:04:10.938859 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-4016ec44-05ef-4064-9e1a-b85a667c52c3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:10.940523 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-4016ec44-05ef-4064-9e1a-b85a667c52c3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:10.952821 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4016ec44-05ef-4064-9e1a-b85a667c52c3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:10.952821 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4016ec44-05ef-4064-9e1a-b85a667c52c3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:10.952821 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4016ec44-05ef-4064-9e1a-b85a667c52c3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:10.952821 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4016ec44-05ef-4064-9e1a-b85a667c52c3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:11.273480 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-4016ec44-05ef-4064-9e1a-b85a667c52c3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:11.290323 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-4016ec44-05ef-4064-9e1a-b85a667c52c3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1322 microversion: 2.1 time: 0.363767 Aug 03 19:04:11.315725 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 83/171] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:10 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1322 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:11.627460 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-0f598989-4000-4245-a5ef-ccc13a229d53 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:11.628538 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-0f598989-4000-4245-a5ef-ccc13a229d53 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:11.629637 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-9d57f9ed-778c-41cd-baf4-5428c03c7545 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:11.630506 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-9d57f9ed-778c-41cd-baf4-5428c03c7545 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:11.641836 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9d57f9ed-778c-41cd-baf4-5428c03c7545 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:11.642805 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9d57f9ed-778c-41cd-baf4-5428c03c7545 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:11.654640 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0f598989-4000-4245-a5ef-ccc13a229d53 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:11.655442 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0f598989-4000-4245-a5ef-ccc13a229d53 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:11.659431 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9d57f9ed-778c-41cd-baf4-5428c03c7545 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:11.660340 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9d57f9ed-778c-41cd-baf4-5428c03c7545 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:11.660671 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0f598989-4000-4245-a5ef-ccc13a229d53 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:11.661433 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0f598989-4000-4245-a5ef-ccc13a229d53 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:11.934928 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-9d57f9ed-778c-41cd-baf4-5428c03c7545 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:11.952137 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-9d57f9ed-778c-41cd-baf4-5428c03c7545 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1363 microversion: 2.1 time: 0.324834 Aug 03 19:04:11.952137 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 84/172] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:11 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1363 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:11.962573 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-0f598989-4000-4245-a5ef-ccc13a229d53 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:11.973551 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-0f598989-4000-4245-a5ef-ccc13a229d53 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1503 microversion: 2.1 time: 0.358168 Aug 03 19:04:11.974877 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 89/173] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:11 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1503 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:12.048585 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-30e1961e-74df-4307-8f0b-10e40707c73f req-51af4b4f-c0fc-49ec-9c94-16bdbf70ea95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfa72c86-34b7-4dc4-b363-fed702f0cebd", "name": "network-vif-plugged", "status": "completed", "tag": "5fb218a1-3622-40cd-840f-fa1f0a049e67"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:04:12.073718 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-30e1961e-74df-4307-8f0b-10e40707c73f req-51af4b4f-c0fc-49ec-9c94-16bdbf70ea95 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:12.074460 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-30e1961e-74df-4307-8f0b-10e40707c73f req-51af4b4f-c0fc-49ec-9c94-16bdbf70ea95 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:12.097459 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-30e1961e-74df-4307-8f0b-10e40707c73f req-51af4b4f-c0fc-49ec-9c94-16bdbf70ea95 service nova] Creating event network-vif-plugged:5fb218a1-3622-40cd-840f-fa1f0a049e67 for instance cfa72c86-34b7-4dc4-b363-fed702f0cebd on hv-cinder-85202 Aug 03 19:04:12.110309 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-30e1961e-74df-4307-8f0b-10e40707c73f req-51af4b4f-c0fc-49ec-9c94-16bdbf70ea95 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069654 Aug 03 19:04:12.111547 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 85/174] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:04:12.337179 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-24b01bd0-26d3-4ecb-8dc1-5df376207a40 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:12.338770 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-24b01bd0-26d3-4ecb-8dc1-5df376207a40 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:12.350889 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-24b01bd0-26d3-4ecb-8dc1-5df376207a40 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:12.351712 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-24b01bd0-26d3-4ecb-8dc1-5df376207a40 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:12.352646 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-24b01bd0-26d3-4ecb-8dc1-5df376207a40 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:12.353251 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-24b01bd0-26d3-4ecb-8dc1-5df376207a40 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:12.381346 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=100 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:04:12.652593 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-24b01bd0-26d3-4ecb-8dc1-5df376207a40 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:12.662467 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-24b01bd0-26d3-4ecb-8dc1-5df376207a40 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1322 microversion: 2.1 time: 0.334782 Aug 03 19:04:12.663062 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 90/175] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:12 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1322 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:04:12.988541 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-e8836265-04f1-40a5-b2d9-07de2a98b049 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:12.989874 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-e8836265-04f1-40a5-b2d9-07de2a98b049 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:12.997481 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e8836265-04f1-40a5-b2d9-07de2a98b049 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:12.997939 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e8836265-04f1-40a5-b2d9-07de2a98b049 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:12.998722 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e8836265-04f1-40a5-b2d9-07de2a98b049 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:12.999189 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e8836265-04f1-40a5-b2d9-07de2a98b049 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:13.167536 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-e8836265-04f1-40a5-b2d9-07de2a98b049 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:13.178866 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-e8836265-04f1-40a5-b2d9-07de2a98b049 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1363 microversion: 2.1 time: 0.196448 Aug 03 19:04:13.179719 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 86/176] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:12 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:13.706178 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-952008a3-03d9-45bd-af6d-3d4825075e8d tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:13.707635 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-952008a3-03d9-45bd-af6d-3d4825075e8d tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:13.717859 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-952008a3-03d9-45bd-af6d-3d4825075e8d tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:13.718482 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-952008a3-03d9-45bd-af6d-3d4825075e8d tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:13.720353 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-952008a3-03d9-45bd-af6d-3d4825075e8d tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:13.721034 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-952008a3-03d9-45bd-af6d-3d4825075e8d tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:13.986622 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-952008a3-03d9-45bd-af6d-3d4825075e8d tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:13.998903 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-952008a3-03d9-45bd-af6d-3d4825075e8d tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1516 microversion: 2.1 time: 0.298174 Aug 03 19:04:13.999899 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 91/177] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:13 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1516 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:04:14.023053 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-9c8da782-6488-44b1-a5af-6753ef176e6e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:04:14.025580 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-9c8da782-6488-44b1-a5af-6753ef176e6e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:14.033081 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9c8da782-6488-44b1-a5af-6753ef176e6e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:14.034029 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9c8da782-6488-44b1-a5af-6753ef176e6e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:14.035301 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9c8da782-6488-44b1-a5af-6753ef176e6e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:14.035991 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9c8da782-6488-44b1-a5af-6753ef176e6e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:14.109808 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.objects.instance [None req-9c8da782-6488-44b1-a5af-6753ef176e6e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lazy-loading 'flavor' on Instance uuid 54ad07ab-f23e-4369-8940-65095533457d {{(pid=118302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:04:14.202249 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-23555c2e-97e1-491c-aa63-db8bc11964d4 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:14.203354 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-23555c2e-97e1-491c-aa63-db8bc11964d4 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:14.209669 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-23555c2e-97e1-491c-aa63-db8bc11964d4 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:14.210118 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-23555c2e-97e1-491c-aa63-db8bc11964d4 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:14.210883 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-23555c2e-97e1-491c-aa63-db8bc11964d4 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:14.211372 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-23555c2e-97e1-491c-aa63-db8bc11964d4 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:14.577811 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-23555c2e-97e1-491c-aa63-db8bc11964d4 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:14.588973 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-23555c2e-97e1-491c-aa63-db8bc11964d4 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1363 microversion: 2.1 time: 0.390711 Aug 03 19:04:14.589705 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 92/178] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:14 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1363 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:04:14.627684 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-9c8da782-6488-44b1-a5af-6753ef176e6e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "POST /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d/action" status: 200 len: 32 microversion: 2.1 time: 0.609751 Aug 03 19:04:14.628365 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 87/179] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 3 19:04:14 2022] POST /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d/action => generated 32 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 19:04:14.646764 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-2bf70eb4-c3f8-4bcf-b398-528ed3eefd5c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:14.647843 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-2bf70eb4-c3f8-4bcf-b398-528ed3eefd5c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:14.655483 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2bf70eb4-c3f8-4bcf-b398-528ed3eefd5c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:14.656473 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2bf70eb4-c3f8-4bcf-b398-528ed3eefd5c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:14.657512 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2bf70eb4-c3f8-4bcf-b398-528ed3eefd5c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:14.658023 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2bf70eb4-c3f8-4bcf-b398-528ed3eefd5c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:14.837347 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-4833d4fa-0388-4991-861a-6e3271506b02 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06450cb5-00e3-4755-a5e9-7e57eb30d031"}} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:04:14.842009 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-4833d4fa-0388-4991-861a-6e3271506b02 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:14.880382 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-2bf70eb4-c3f8-4bcf-b398-528ed3eefd5c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:14.896683 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4833d4fa-0388-4991-861a-6e3271506b02 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:14.897147 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4833d4fa-0388-4991-861a-6e3271506b02 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:14.901463 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4833d4fa-0388-4991-861a-6e3271506b02 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:14.901908 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4833d4fa-0388-4991-861a-6e3271506b02 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:14.909276 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-2bf70eb4-c3f8-4bcf-b398-528ed3eefd5c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1522 microversion: 2.1 time: 0.271418 Aug 03 19:04:14.910307 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 93/180] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:14 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:15.621481 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-9cee4117-5eb7-44db-ae1a-5eda41589601 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:15.622534 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-9cee4117-5eb7-44db-ae1a-5eda41589601 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:15.635772 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9cee4117-5eb7-44db-ae1a-5eda41589601 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:15.636139 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9cee4117-5eb7-44db-ae1a-5eda41589601 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:15.637451 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9cee4117-5eb7-44db-ae1a-5eda41589601 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:15.638179 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9cee4117-5eb7-44db-ae1a-5eda41589601 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:15.959285 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-9cee4117-5eb7-44db-ae1a-5eda41589601 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:15.972056 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-9cee4117-5eb7-44db-ae1a-5eda41589601 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1548 microversion: 2.1 time: 0.359767 Aug 03 19:04:15.975789 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 94/181] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:15 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1548 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:15.982063 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-18775c62-1522-4e86-989d-f57231c7a576 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:15.982912 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-18775c62-1522-4e86-989d-f57231c7a576 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:15.990205 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-18775c62-1522-4e86-989d-f57231c7a576 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:15.990977 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-18775c62-1522-4e86-989d-f57231c7a576 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:15.992243 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-18775c62-1522-4e86-989d-f57231c7a576 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:15.992889 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-18775c62-1522-4e86-989d-f57231c7a576 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:16.201577 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-18775c62-1522-4e86-989d-f57231c7a576 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:16.210986 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-18775c62-1522-4e86-989d-f57231c7a576 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1522 microversion: 2.1 time: 0.233177 Aug 03 19:04:16.211603 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 95/182] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:15 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:16.232170 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-5703285e-05e2-486d-a5e3-eb52164e5c13 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:16.232170 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-5703285e-05e2-486d-a5e3-eb52164e5c13 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:16.232170 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5703285e-05e2-486d-a5e3-eb52164e5c13 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:16.232170 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5703285e-05e2-486d-a5e3-eb52164e5c13 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:16.232620 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5703285e-05e2-486d-a5e3-eb52164e5c13 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:16.232620 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5703285e-05e2-486d-a5e3-eb52164e5c13 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:16.444349 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-5703285e-05e2-486d-a5e3-eb52164e5c13 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.229415 Aug 03 19:04:16.445471 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 96/183] 10.222.0.77 () {58 vars in 1275 bytes} [Wed Aug 3 19:04:16 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd/os-interface => generated 284 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:04:16.659422 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:04:17.013646 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-4833d4fa-0388-4991-861a-6e3271506b02 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "POST /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.183338 Aug 03 19:04:17.014752 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 88/184] 10.222.0.77 () {60 vars in 1323 bytes} [Wed Aug 3 19:04:14 2022] POST /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c/os-volume_attachments => generated 194 bytes in 2187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:04:17.246200 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-ab88aae9-29f9-4e0d-9484-ee6c7e4e2230 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:17.249875 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-ab88aae9-29f9-4e0d-9484-ee6c7e4e2230 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:17.267909 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ab88aae9-29f9-4e0d-9484-ee6c7e4e2230 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:17.268594 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ab88aae9-29f9-4e0d-9484-ee6c7e4e2230 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:17.269747 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ab88aae9-29f9-4e0d-9484-ee6c7e4e2230 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:17.270426 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ab88aae9-29f9-4e0d-9484-ee6c7e4e2230 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:17.601173 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-ab88aae9-29f9-4e0d-9484-ee6c7e4e2230 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:17.617992 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-ab88aae9-29f9-4e0d-9484-ee6c7e4e2230 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1522 microversion: 2.1 time: 0.388348 Aug 03 19:04:17.619645 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 97/185] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:17 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1522 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:18.287285 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-9bbd2dff-ee13-487d-800d-e26ad12c782d req-23718dbb-fa0d-4bcc-8daa-db05fc22e226 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfa72c86-34b7-4dc4-b363-fed702f0cebd", "tag": "5fb218a1-3622-40cd-840f-fa1f0a049e67"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:04:18.305707 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-9bbd2dff-ee13-487d-800d-e26ad12c782d req-23718dbb-fa0d-4bcc-8daa-db05fc22e226 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:18.306152 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-9bbd2dff-ee13-487d-800d-e26ad12c782d req-23718dbb-fa0d-4bcc-8daa-db05fc22e226 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:18.336151 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-9bbd2dff-ee13-487d-800d-e26ad12c782d req-23718dbb-fa0d-4bcc-8daa-db05fc22e226 service nova] Creating event network-changed:5fb218a1-3622-40cd-840f-fa1f0a049e67 for instance cfa72c86-34b7-4dc4-b363-fed702f0cebd on hv-cinder-85202 Aug 03 19:04:18.366085 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-9bbd2dff-ee13-487d-800d-e26ad12c782d req-23718dbb-fa0d-4bcc-8daa-db05fc22e226 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076348 Aug 03 19:04:18.366844 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 89/186] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:04:18.657595 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-f17f4cdc-27ff-417a-a13a-e740a2bf5a6f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:18.659729 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-f17f4cdc-27ff-417a-a13a-e740a2bf5a6f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:18.668922 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f17f4cdc-27ff-417a-a13a-e740a2bf5a6f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:18.669687 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f17f4cdc-27ff-417a-a13a-e740a2bf5a6f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:18.670740 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f17f4cdc-27ff-417a-a13a-e740a2bf5a6f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:18.671373 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f17f4cdc-27ff-417a-a13a-e740a2bf5a6f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:18.865855 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-f17f4cdc-27ff-417a-a13a-e740a2bf5a6f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:18.877912 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-f17f4cdc-27ff-417a-a13a-e740a2bf5a6f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1522 microversion: 2.1 time: 0.226905 Aug 03 19:04:18.878808 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 98/187] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:18 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:19.917166 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-2ddb0098-04a9-4fe6-8f30-d60f865843e4 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:19.918521 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-2ddb0098-04a9-4fe6-8f30-d60f865843e4 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:19.928199 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2ddb0098-04a9-4fe6-8f30-d60f865843e4 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:19.928975 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2ddb0098-04a9-4fe6-8f30-d60f865843e4 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:19.930219 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2ddb0098-04a9-4fe6-8f30-d60f865843e4 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:19.931167 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2ddb0098-04a9-4fe6-8f30-d60f865843e4 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:20.136481 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-2ddb0098-04a9-4fe6-8f30-d60f865843e4 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:20.150296 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-2ddb0098-04a9-4fe6-8f30-d60f865843e4 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1522 microversion: 2.1 time: 0.239385 Aug 03 19:04:20.151964 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 90/188] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:19 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:04:21.173577 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-bc932d21-68ab-4a41-a166-807c6c5ade54 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:21.174258 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-bc932d21-68ab-4a41-a166-807c6c5ade54 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:21.183036 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-bc932d21-68ab-4a41-a166-807c6c5ade54 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:21.183489 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-bc932d21-68ab-4a41-a166-807c6c5ade54 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:21.184271 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-bc932d21-68ab-4a41-a166-807c6c5ade54 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:21.184765 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-bc932d21-68ab-4a41-a166-807c6c5ade54 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:21.432882 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-bc932d21-68ab-4a41-a166-807c6c5ade54 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:21.442435 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-bc932d21-68ab-4a41-a166-807c6c5ade54 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1522 microversion: 2.1 time: 0.272309 Aug 03 19:04:21.443359 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 99/189] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:21 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:22.475144 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-d9ae162c-b250-42a3-9a49-2484f1e44ead tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:22.476034 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-d9ae162c-b250-42a3-9a49-2484f1e44ead tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:22.487557 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d9ae162c-b250-42a3-9a49-2484f1e44ead tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:22.488288 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d9ae162c-b250-42a3-9a49-2484f1e44ead tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:22.489078 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d9ae162c-b250-42a3-9a49-2484f1e44ead tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:22.489526 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d9ae162c-b250-42a3-9a49-2484f1e44ead tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:22.693702 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-d9ae162c-b250-42a3-9a49-2484f1e44ead tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:22.710829 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-d9ae162c-b250-42a3-9a49-2484f1e44ead tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1522 microversion: 2.1 time: 0.239240 Aug 03 19:04:22.726589 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 91/190] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:22 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:23.733817 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-f88f2137-5b78-4c4a-9202-b94d215e9214 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:23.734416 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-f88f2137-5b78-4c4a-9202-b94d215e9214 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:23.748192 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f88f2137-5b78-4c4a-9202-b94d215e9214 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:23.749050 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f88f2137-5b78-4c4a-9202-b94d215e9214 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:23.750059 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f88f2137-5b78-4c4a-9202-b94d215e9214 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:23.750765 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f88f2137-5b78-4c4a-9202-b94d215e9214 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:23.941769 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-f88f2137-5b78-4c4a-9202-b94d215e9214 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:23.951948 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-f88f2137-5b78-4c4a-9202-b94d215e9214 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1522 microversion: 2.1 time: 0.221914 Aug 03 19:04:23.953044 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 100/191] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:23 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:24.977483 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-bc1dfd24-a7d6-443d-a8f3-b1ae5c7db2de tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:24.980024 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-bc1dfd24-a7d6-443d-a8f3-b1ae5c7db2de tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:24.991678 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-bc1dfd24-a7d6-443d-a8f3-b1ae5c7db2de tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:24.992816 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-bc1dfd24-a7d6-443d-a8f3-b1ae5c7db2de tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:24.994410 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-bc1dfd24-a7d6-443d-a8f3-b1ae5c7db2de tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:24.995638 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-bc1dfd24-a7d6-443d-a8f3-b1ae5c7db2de tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:25.423551 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-bc1dfd24-a7d6-443d-a8f3-b1ae5c7db2de tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:25.434567 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-bc1dfd24-a7d6-443d-a8f3-b1ae5c7db2de tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1522 microversion: 2.1 time: 0.463517 Aug 03 19:04:25.438111 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 92/192] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:24 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1522 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:04:26.458526 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-4de062b0-bc0f-40c8-bd14-c0c99a238cae tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:26.459453 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-4de062b0-bc0f-40c8-bd14-c0c99a238cae tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:26.468000 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4de062b0-bc0f-40c8-bd14-c0c99a238cae tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:26.468541 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4de062b0-bc0f-40c8-bd14-c0c99a238cae tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:26.469963 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4de062b0-bc0f-40c8-bd14-c0c99a238cae tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:26.470155 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4de062b0-bc0f-40c8-bd14-c0c99a238cae tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:26.643823 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-4de062b0-bc0f-40c8-bd14-c0c99a238cae tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:26.656630 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-4de062b0-bc0f-40c8-bd14-c0c99a238cae tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1522 microversion: 2.1 time: 0.202039 Aug 03 19:04:26.658319 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 101/193] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:26 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:27.684262 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-00748e35-f38c-482b-86de-cfd249679e0c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:27.685367 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-00748e35-f38c-482b-86de-cfd249679e0c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:27.694663 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-00748e35-f38c-482b-86de-cfd249679e0c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:27.695150 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-00748e35-f38c-482b-86de-cfd249679e0c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:27.695925 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-00748e35-f38c-482b-86de-cfd249679e0c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:27.696362 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-00748e35-f38c-482b-86de-cfd249679e0c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:27.924532 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-00748e35-f38c-482b-86de-cfd249679e0c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:27.935413 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-00748e35-f38c-482b-86de-cfd249679e0c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1522 microversion: 2.1 time: 0.256999 Aug 03 19:04:27.936957 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 93/194] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:27 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:28.959415 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-b6a2e526-f583-4914-8c7b-84910d02cad0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:28.960813 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-b6a2e526-f583-4914-8c7b-84910d02cad0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:28.967643 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b6a2e526-f583-4914-8c7b-84910d02cad0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:28.968098 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b6a2e526-f583-4914-8c7b-84910d02cad0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:28.968876 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b6a2e526-f583-4914-8c7b-84910d02cad0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:28.969310 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b6a2e526-f583-4914-8c7b-84910d02cad0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:29.141949 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-b6a2e526-f583-4914-8c7b-84910d02cad0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:29.149722 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-b6a2e526-f583-4914-8c7b-84910d02cad0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1522 microversion: 2.1 time: 0.196200 Aug 03 19:04:29.150281 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 102/195] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:28 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:30.175685 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-94b30aca-73ff-4818-b862-8f8296dd3e6a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:30.177447 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-94b30aca-73ff-4818-b862-8f8296dd3e6a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:30.188654 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-94b30aca-73ff-4818-b862-8f8296dd3e6a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:30.190008 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-94b30aca-73ff-4818-b862-8f8296dd3e6a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:30.192157 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-94b30aca-73ff-4818-b862-8f8296dd3e6a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:30.193173 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-94b30aca-73ff-4818-b862-8f8296dd3e6a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:30.448432 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-94b30aca-73ff-4818-b862-8f8296dd3e6a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:30.459036 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-94b30aca-73ff-4818-b862-8f8296dd3e6a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1522 microversion: 2.1 time: 0.288637 Aug 03 19:04:30.459640 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 94/196] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:30 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:31.497921 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-8cfca925-dedf-4749-b32c-e24bb807823a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:31.499205 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-8cfca925-dedf-4749-b32c-e24bb807823a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:31.506075 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8cfca925-dedf-4749-b32c-e24bb807823a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:31.506914 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8cfca925-dedf-4749-b32c-e24bb807823a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:31.507991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8cfca925-dedf-4749-b32c-e24bb807823a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:31.508475 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8cfca925-dedf-4749-b32c-e24bb807823a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:31.693352 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-8cfca925-dedf-4749-b32c-e24bb807823a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:31.702164 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-8cfca925-dedf-4749-b32c-e24bb807823a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1522 microversion: 2.1 time: 0.208553 Aug 03 19:04:31.702751 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 103/197] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:31 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:32.464172 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-185e55e8-a0bf-4fb3-bf05-524dc631d765 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:32.464944 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-185e55e8-a0bf-4fb3-bf05-524dc631d765 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:32.472942 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-185e55e8-a0bf-4fb3-bf05-524dc631d765 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:32.473984 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-185e55e8-a0bf-4fb3-bf05-524dc631d765 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:32.475294 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-185e55e8-a0bf-4fb3-bf05-524dc631d765 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:32.475883 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-185e55e8-a0bf-4fb3-bf05-524dc631d765 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:32.551168 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-185e55e8-a0bf-4fb3-bf05-524dc631d765 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Going to try to terminate instance {{(pid=118302) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 19:04:32.728336 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-0f2171c5-268f-41dc-a140-3fc34b9bad15 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:32.729983 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-0f2171c5-268f-41dc-a140-3fc34b9bad15 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:32.737424 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0f2171c5-268f-41dc-a140-3fc34b9bad15 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:32.737947 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0f2171c5-268f-41dc-a140-3fc34b9bad15 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:32.739019 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0f2171c5-268f-41dc-a140-3fc34b9bad15 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:32.739519 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0f2171c5-268f-41dc-a140-3fc34b9bad15 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:32.970453 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-185e55e8-a0bf-4fb3-bf05-524dc631d765 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "DELETE /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 204 len: 0 microversion: 2.1 time: 0.512534 Aug 03 19:04:32.970867 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-0f2171c5-268f-41dc-a140-3fc34b9bad15 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:32.976114 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 95/198] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 3 19:04:32 2022] DELETE /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 0 bytes in 515 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 19:04:32.982192 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-0f2171c5-268f-41dc-a140-3fc34b9bad15 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1522 microversion: 2.1 time: 0.258750 Aug 03 19:04:32.982841 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-2d45ce49-6676-4951-a5ef-fb3e0adce28a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:32.983364 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 104/199] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:32 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:04:32.983664 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-2d45ce49-6676-4951-a5ef-fb3e0adce28a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:32.990069 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2d45ce49-6676-4951-a5ef-fb3e0adce28a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:32.990515 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2d45ce49-6676-4951-a5ef-fb3e0adce28a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:32.991326 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2d45ce49-6676-4951-a5ef-fb3e0adce28a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:32.991793 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2d45ce49-6676-4951-a5ef-fb3e0adce28a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:33.200997 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-2d45ce49-6676-4951-a5ef-fb3e0adce28a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:33.212790 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-2d45ce49-6676-4951-a5ef-fb3e0adce28a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1555 microversion: 2.1 time: 0.235243 Aug 03 19:04:33.214516 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 96/200] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:32 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1555 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:04:34.009634 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-4883af4b-a0a5-42aa-a673-b999ba5b4456 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:34.011147 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-4883af4b-a0a5-42aa-a673-b999ba5b4456 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:34.022448 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4883af4b-a0a5-42aa-a673-b999ba5b4456 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:34.023429 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4883af4b-a0a5-42aa-a673-b999ba5b4456 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:34.024410 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4883af4b-a0a5-42aa-a673-b999ba5b4456 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:34.025020 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4883af4b-a0a5-42aa-a673-b999ba5b4456 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:34.229220 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-4883af4b-a0a5-42aa-a673-b999ba5b4456 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:34.238856 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-4883af4b-a0a5-42aa-a673-b999ba5b4456 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1522 microversion: 2.1 time: 0.233489 Aug 03 19:04:34.245476 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-00ef471c-c1e2-4b7f-a3bd-b971ad90b782 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:34.246705 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-00ef471c-c1e2-4b7f-a3bd-b971ad90b782 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:34.251497 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 105/201] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:34 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:34.268944 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-00ef471c-c1e2-4b7f-a3bd-b971ad90b782 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:34.268944 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-00ef471c-c1e2-4b7f-a3bd-b971ad90b782 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:34.268944 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-00ef471c-c1e2-4b7f-a3bd-b971ad90b782 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:34.268944 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-00ef471c-c1e2-4b7f-a3bd-b971ad90b782 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:34.560092 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-00ef471c-c1e2-4b7f-a3bd-b971ad90b782 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:34.572110 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-00ef471c-c1e2-4b7f-a3bd-b971ad90b782 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1555 microversion: 2.1 time: 0.331954 Aug 03 19:04:34.587825 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 97/202] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:34 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1555 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:35.269052 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-4d5c2ff2-c14e-4cf2-81f5-e4747e572ea1 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:35.270109 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-4d5c2ff2-c14e-4cf2-81f5-e4747e572ea1 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:35.273165 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_api:SELECT=50 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:04:35.281857 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4d5c2ff2-c14e-4cf2-81f5-e4747e572ea1 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:35.282653 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4d5c2ff2-c14e-4cf2-81f5-e4747e572ea1 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:35.284264 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4d5c2ff2-c14e-4cf2-81f5-e4747e572ea1 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:35.285028 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4d5c2ff2-c14e-4cf2-81f5-e4747e572ea1 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:35.563603 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-4d5c2ff2-c14e-4cf2-81f5-e4747e572ea1 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:35.574270 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-4d5c2ff2-c14e-4cf2-81f5-e4747e572ea1 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1522 microversion: 2.1 time: 0.312659 Aug 03 19:04:35.576003 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 106/203] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:35 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:35.597419 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-ebb89c3d-8f9c-4617-a1bf-17344a0900f6 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:35.598282 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-ebb89c3d-8f9c-4617-a1bf-17344a0900f6 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:35.601155 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:04:35.608146 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ebb89c3d-8f9c-4617-a1bf-17344a0900f6 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:35.609570 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ebb89c3d-8f9c-4617-a1bf-17344a0900f6 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:35.610444 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ebb89c3d-8f9c-4617-a1bf-17344a0900f6 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:35.610891 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ebb89c3d-8f9c-4617-a1bf-17344a0900f6 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:35.862215 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-ebb89c3d-8f9c-4617-a1bf-17344a0900f6 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:35.877825 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-ebb89c3d-8f9c-4617-a1bf-17344a0900f6 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1555 microversion: 2.1 time: 0.285859 Aug 03 19:04:35.890253 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 98/204] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:35 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1555 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:36.605078 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-6498ddfa-0f34-41c5-aecf-6a8ad46492b7 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:36.606230 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-6498ddfa-0f34-41c5-aecf-6a8ad46492b7 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:36.621032 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6498ddfa-0f34-41c5-aecf-6a8ad46492b7 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:36.622147 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6498ddfa-0f34-41c5-aecf-6a8ad46492b7 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:36.623724 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6498ddfa-0f34-41c5-aecf-6a8ad46492b7 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:36.624677 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6498ddfa-0f34-41c5-aecf-6a8ad46492b7 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:36.627946 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-cee37958-fbb2-4647-9727-0c8eed51a1c3 req-9780f1d2-6756-4450-b4ab-36565dba9ba9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "272088aa-31e7-465f-a224-b49f3a86497c", "name": "network-vif-deleted", "tag": "77e656cc-d42d-42c8-bbff-4d87ddc50476"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:04:36.650582 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-cee37958-fbb2-4647-9727-0c8eed51a1c3 req-9780f1d2-6756-4450-b4ab-36565dba9ba9 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:36.667960 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-cee37958-fbb2-4647-9727-0c8eed51a1c3 req-9780f1d2-6756-4450-b4ab-36565dba9ba9 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:36.678725 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=100 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:04:36.702270 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-cee37958-fbb2-4647-9727-0c8eed51a1c3 req-9780f1d2-6756-4450-b4ab-36565dba9ba9 service nova] Creating event network-vif-deleted:77e656cc-d42d-42c8-bbff-4d87ddc50476 for instance 272088aa-31e7-465f-a224-b49f3a86497c on hv-cinder-85202 Aug 03 19:04:36.707029 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-cee37958-fbb2-4647-9727-0c8eed51a1c3 req-9780f1d2-6756-4450-b4ab-36565dba9ba9 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089509 Aug 03 19:04:36.708360 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 99/205] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 19:04:36.917390 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-da2cbf9f-d58c-4475-8419-af2543e95ce0 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:36.920433 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-da2cbf9f-d58c-4475-8419-af2543e95ce0 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:36.940358 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-da2cbf9f-d58c-4475-8419-af2543e95ce0 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:36.949360 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-da2cbf9f-d58c-4475-8419-af2543e95ce0 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:36.951660 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-da2cbf9f-d58c-4475-8419-af2543e95ce0 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:36.954577 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-da2cbf9f-d58c-4475-8419-af2543e95ce0 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:37.042719 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-6498ddfa-0f34-41c5-aecf-6a8ad46492b7 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:37.064868 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-6498ddfa-0f34-41c5-aecf-6a8ad46492b7 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1522 microversion: 2.1 time: 0.464575 Aug 03 19:04:37.067576 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 107/206] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:36 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1522 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:37.126214 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-da2cbf9f-d58c-4475-8419-af2543e95ce0 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:37.142488 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-da2cbf9f-d58c-4475-8419-af2543e95ce0 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1346 microversion: 2.1 time: 0.234373 Aug 03 19:04:37.155913 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 100/207] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:36 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1346 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:38.095089 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-aa6ecd0b-eb53-48ca-9721-1adb551ba06c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:38.095878 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-aa6ecd0b-eb53-48ca-9721-1adb551ba06c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:38.108935 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-aa6ecd0b-eb53-48ca-9721-1adb551ba06c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:38.109477 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-aa6ecd0b-eb53-48ca-9721-1adb551ba06c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:38.110258 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-aa6ecd0b-eb53-48ca-9721-1adb551ba06c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:38.110694 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-aa6ecd0b-eb53-48ca-9721-1adb551ba06c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:38.175289 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-2e16d413-b5a5-48b2-8218-8d7f7682b88a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:38.176401 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-2e16d413-b5a5-48b2-8218-8d7f7682b88a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:38.185821 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2e16d413-b5a5-48b2-8218-8d7f7682b88a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:38.186570 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2e16d413-b5a5-48b2-8218-8d7f7682b88a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:38.187402 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2e16d413-b5a5-48b2-8218-8d7f7682b88a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:38.187865 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2e16d413-b5a5-48b2-8218-8d7f7682b88a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:38.234107 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2e16d413-b5a5-48b2-8218-8d7f7682b88a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:38.234840 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2e16d413-b5a5-48b2-8218-8d7f7682b88a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:38.235388 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.objects.instance [None req-2e16d413-b5a5-48b2-8218-8d7f7682b88a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lazy-loading 'fault' on Instance uuid 272088aa-31e7-465f-a224-b49f3a86497c {{(pid=118302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:04:38.318073 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-2e16d413-b5a5-48b2-8218-8d7f7682b88a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52859bea3baf4e968e49df4e4d4aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee13f75b9c99495cb17bb8f88590a029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:38.330809 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-aa6ecd0b-eb53-48ca-9721-1adb551ba06c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:38.335903 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-2e16d413-b5a5-48b2-8218-8d7f7682b88a tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 200 len: 1351 microversion: 2.1 time: 0.166185 Aug 03 19:04:38.336983 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 101/208] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:38 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 1351 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:38.350450 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-aa6ecd0b-eb53-48ca-9721-1adb551ba06c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1522 microversion: 2.1 time: 0.262995 Aug 03 19:04:38.351069 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 108/209] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:38 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:39.379705 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-fc56529d-c04b-4618-b0bd-993a8a26d398 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:39.381826 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-fd5a0019-14f2-4121-902f-9b1155e8eb06 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:39.381826 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-fd5a0019-14f2-4121-902f-9b1155e8eb06 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:39.383434 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-fc56529d-c04b-4618-b0bd-993a8a26d398 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:39.406020 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fc56529d-c04b-4618-b0bd-993a8a26d398 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:39.407412 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fc56529d-c04b-4618-b0bd-993a8a26d398 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:39.414104 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fc56529d-c04b-4618-b0bd-993a8a26d398 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:39.414104 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fc56529d-c04b-4618-b0bd-993a8a26d398 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:39.415466 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fd5a0019-14f2-4121-902f-9b1155e8eb06 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:39.418429 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fd5a0019-14f2-4121-902f-9b1155e8eb06 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:39.421038 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fd5a0019-14f2-4121-902f-9b1155e8eb06 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:39.423009 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fd5a0019-14f2-4121-902f-9b1155e8eb06 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:39.459805 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.wsgi [None req-fd5a0019-14f2-4121-902f-9b1155e8eb06 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] HTTP exception thrown: Instance 272088aa-31e7-465f-a224-b49f3a86497c could not be found. Aug 03 19:04:39.485106 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-fd5a0019-14f2-4121-902f-9b1155e8eb06 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Request method failure captured: Aug 03 19:04:39.485106 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: request: GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c HTTP/1.1 Aug 03 19:04:39.485106 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept: application/json Aug 03 19:04:39.485106 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept-Encoding: identity Aug 03 19:04:39.485106 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Connection: close Aug 03 19:04:39.485106 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Length: 0 Aug 03 19:04:39.485106 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Type: application/json Aug 03 19:04:39.485106 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Host: 10.222.0.77 Aug 03 19:04:39.485106 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Openstack-System-Scope: None Aug 03 19:04:39.485106 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: User-Agent: python-urllib3/1.26.11 Aug 03 19:04:39.485106 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Auth-Token: gAAAAABi6sZrkD-bAKl1IUEDp4h0mSyE1Y7UfQQtEn8ICwc5D87va9OO-PsXOZWD2NDQ0dBbJSJ_i_TtCz5oVPqON2SoSZ5ogGsbi7blSn37UThIH7n4R9vM0N1AuAg2OVyXbI1s579OrYDffEkNOlZvTZ4_g19BY4sUOxA6QMb3uE-62h_9U1M Aug 03 19:04:39.485106 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Id: None Aug 03 19:04:39.485106 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Name: None Aug 03 19:04:39.485106 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Identity-Status: Confirmed Aug 03 19:04:39.485106 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Is-Admin-Project: True Aug 03 19:04:39.485106 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Id: default Aug 03 19:04:39.485106 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Name: Default Aug 03 19:04:39.485106 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Id: ee13f75b9c99495cb17bb8f88590a029 Aug 03 19:04:39.485106 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Name: tempest-DeleteServersTestJSON-1823572287 Aug 03 19:04:39.485106 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Role: reader,member Aug 03 19:04:39.485106 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Roles: reader,member Aug 03 19:04:39.487882 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_ee13f75b9c99495cb17bb8f88590a029", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/ee13f75b9c99495cb17bb8f88590a029"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/ee13f75b9c99495cb17bb8f88590a029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/ee13f75b9c99495cb17bb8f88590a029"}]}] Aug 03 19:04:39.487882 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant: tempest-DeleteServersTestJSON-1823572287 Aug 03 19:04:39.487882 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Id: ee13f75b9c99495cb17bb8f88590a029 Aug 03 19:04:39.487882 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Name: tempest-DeleteServersTestJSON-1823572287 Aug 03 19:04:39.487882 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User: tempest-DeleteServersTestJSON-1823572287-project Aug 03 19:04:39.487882 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Id: default Aug 03 19:04:39.487882 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Name: Default Aug 03 19:04:39.487882 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Id: 52859bea3baf4e968e49df4e4d4aecf0 Aug 03 19:04:39.487882 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Name: tempest-DeleteServersTestJSON-1823572287-project Aug 03 19:04:39.487882 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: method: > Aug 03 19:04:39.487882 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: exception: Instance 272088aa-31e7-465f-a224-b49f3a86497c could not be found. Aug 03 19:04:39.487882 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: action_args: {'id': '272088aa-31e7-465f-a224-b49f3a86497c'} Aug 03 19:04:39.489263 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:04:39.489263 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:04:39.489263 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:04:39.489263 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:04:39.489263 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:04:39.489263 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:04:39.489263 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:04:39.489263 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:04:39.489263 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:04:39.489263 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:04:39.489263 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 272088aa-31e7-465f-a224-b49f3a86497c could not be found. Aug 03 19:04:39.489263 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:04:39.489263 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:04:39.489263 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:04:39.489263 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:04:39.489263 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:04:39.489263 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:04:39.489263 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:04:39.489263 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:04:39.489263 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:04:39.490421 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:04:39.490421 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:04:39.490421 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:04:39.490421 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:04:39.490421 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:04:39.490421 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:04:39.490421 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:04:39.490421 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 272088aa-31e7-465f-a224-b49f3a86497c could not be found. Aug 03 19:04:39.490421 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:04:39.490421 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:04:39.490421 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:04:39.490421 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:04:39.490421 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:04:39.490421 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:04:39.490421 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:04:39.490421 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:04:39.490421 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 272088aa-31e7-465f-a224-b49f3a86497c could not be found. Aug 03 19:04:39.490421 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:04:39.491702 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-fd5a0019-14f2-4121-902f-9b1155e8eb06 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Returning 404 to user: Instance 272088aa-31e7-465f-a224-b49f3a86497c could not be found. {{(pid=118302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:04:39.495056 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-fd5a0019-14f2-4121-902f-9b1155e8eb06 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 404 len: 111 microversion: 2.1 time: 0.125602 Aug 03 19:04:39.502373 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 102/210] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:39 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:04:39.666292 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-fc56529d-c04b-4618-b0bd-993a8a26d398 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:39.678586 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-fc56529d-c04b-4618-b0bd-993a8a26d398 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1522 microversion: 2.1 time: 0.308715 Aug 03 19:04:39.679673 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 109/211] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:39 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:39.727910 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-661a0bea-2bf9-46ae-8336-a97810d785cb tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:39.732123 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-661a0bea-2bf9-46ae-8336-a97810d785cb tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:39.742777 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-661a0bea-2bf9-46ae-8336-a97810d785cb tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:39.743786 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-661a0bea-2bf9-46ae-8336-a97810d785cb tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:39.745078 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-661a0bea-2bf9-46ae-8336-a97810d785cb tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:39.745800 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-661a0bea-2bf9-46ae-8336-a97810d785cb tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:39.768879 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.wsgi [None req-661a0bea-2bf9-46ae-8336-a97810d785cb tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] HTTP exception thrown: Instance 272088aa-31e7-465f-a224-b49f3a86497c could not be found. Aug 03 19:04:39.771521 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-661a0bea-2bf9-46ae-8336-a97810d785cb tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Request method failure captured: Aug 03 19:04:39.771521 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: request: GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c/os-volume_attachments HTTP/1.1 Aug 03 19:04:39.771521 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept: application/json Aug 03 19:04:39.771521 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept-Encoding: identity Aug 03 19:04:39.771521 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Connection: close Aug 03 19:04:39.771521 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Length: 0 Aug 03 19:04:39.771521 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Type: application/json Aug 03 19:04:39.771521 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Host: 10.222.0.77 Aug 03 19:04:39.771521 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Openstack-System-Scope: None Aug 03 19:04:39.771521 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: User-Agent: python-urllib3/1.26.11 Aug 03 19:04:39.771521 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Auth-Token: gAAAAABi6sZrkD-bAKl1IUEDp4h0mSyE1Y7UfQQtEn8ICwc5D87va9OO-PsXOZWD2NDQ0dBbJSJ_i_TtCz5oVPqON2SoSZ5ogGsbi7blSn37UThIH7n4R9vM0N1AuAg2OVyXbI1s579OrYDffEkNOlZvTZ4_g19BY4sUOxA6QMb3uE-62h_9U1M Aug 03 19:04:39.771521 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Id: None Aug 03 19:04:39.771521 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Name: None Aug 03 19:04:39.771521 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Identity-Status: Confirmed Aug 03 19:04:39.771521 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Is-Admin-Project: True Aug 03 19:04:39.771521 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Id: default Aug 03 19:04:39.771521 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Name: Default Aug 03 19:04:39.771521 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Id: ee13f75b9c99495cb17bb8f88590a029 Aug 03 19:04:39.771521 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Name: tempest-DeleteServersTestJSON-1823572287 Aug 03 19:04:39.771521 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Role: reader,member Aug 03 19:04:39.771521 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Roles: reader,member Aug 03 19:04:39.774162 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_ee13f75b9c99495cb17bb8f88590a029", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/ee13f75b9c99495cb17bb8f88590a029"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/ee13f75b9c99495cb17bb8f88590a029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/ee13f75b9c99495cb17bb8f88590a029"}]}] Aug 03 19:04:39.774162 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant: tempest-DeleteServersTestJSON-1823572287 Aug 03 19:04:39.774162 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Id: ee13f75b9c99495cb17bb8f88590a029 Aug 03 19:04:39.774162 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Name: tempest-DeleteServersTestJSON-1823572287 Aug 03 19:04:39.774162 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User: tempest-DeleteServersTestJSON-1823572287-project Aug 03 19:04:39.774162 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Id: default Aug 03 19:04:39.774162 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Name: Default Aug 03 19:04:39.774162 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Id: 52859bea3baf4e968e49df4e4d4aecf0 Aug 03 19:04:39.774162 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Name: tempest-DeleteServersTestJSON-1823572287-project Aug 03 19:04:39.774162 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: method: > Aug 03 19:04:39.774162 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: exception: Instance 272088aa-31e7-465f-a224-b49f3a86497c could not be found. Aug 03 19:04:39.774162 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: action_args: {'server_id': '272088aa-31e7-465f-a224-b49f3a86497c'} Aug 03 19:04:39.775168 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:04:39.775168 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:04:39.775168 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:04:39.775168 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:04:39.775168 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:04:39.775168 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:04:39.775168 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:04:39.775168 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:04:39.775168 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:04:39.775168 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:04:39.775168 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 272088aa-31e7-465f-a224-b49f3a86497c could not be found. Aug 03 19:04:39.775168 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:04:39.775168 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:04:39.775168 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:04:39.775168 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:04:39.775168 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:04:39.775168 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:04:39.775168 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:04:39.775168 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:04:39.775168 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:04:39.778046 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:04:39.778046 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 19:04:39.778046 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 19:04:39.778046 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 19:04:39.778046 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 19:04:39.778046 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 03 19:04:39.778046 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 03 19:04:39.778046 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:04:39.778046 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:04:39.778046 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 272088aa-31e7-465f-a224-b49f3a86497c could not be found. Aug 03 19:04:39.778046 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:04:39.778046 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:04:39.778046 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:04:39.778046 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:04:39.778046 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:04:39.778046 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:04:39.778046 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:04:39.778046 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:04:39.778046 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 272088aa-31e7-465f-a224-b49f3a86497c could not be found. Aug 03 19:04:39.778046 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:04:39.779884 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-661a0bea-2bf9-46ae-8336-a97810d785cb tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Returning 404 to user: Instance 272088aa-31e7-465f-a224-b49f3a86497c could not be found. {{(pid=118302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:04:39.779884 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-661a0bea-2bf9-46ae-8336-a97810d785cb tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.053526 Aug 03 19:04:39.779884 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 103/212] 10.222.0.77 () {58 vars in 1302 bytes} [Wed Aug 3 19:04:39 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c/os-volume_attachments => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:04:40.718452 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-79fab21e-b4f9-459d-894d-46de37215888 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:40.720054 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-79fab21e-b4f9-459d-894d-46de37215888 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:40.732943 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-79fab21e-b4f9-459d-894d-46de37215888 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:40.732943 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-79fab21e-b4f9-459d-894d-46de37215888 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:40.732943 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-79fab21e-b4f9-459d-894d-46de37215888 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:40.733583 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-79fab21e-b4f9-459d-894d-46de37215888 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:41.003566 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-79fab21e-b4f9-459d-894d-46de37215888 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:41.015913 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-79fab21e-b4f9-459d-894d-46de37215888 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1522 microversion: 2.1 time: 0.306892 Aug 03 19:04:41.017059 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 110/213] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:40 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:04:41.470312 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-29917a60-dd73-4fef-938d-e0b63d980787 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:41.470907 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-29917a60-dd73-4fef-938d-e0b63d980787 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:41.478344 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-29917a60-dd73-4fef-938d-e0b63d980787 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:41.479247 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-29917a60-dd73-4fef-938d-e0b63d980787 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:41.480388 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-29917a60-dd73-4fef-938d-e0b63d980787 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:41.480857 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-29917a60-dd73-4fef-938d-e0b63d980787 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:41.501264 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.wsgi [None req-29917a60-dd73-4fef-938d-e0b63d980787 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] HTTP exception thrown: Instance 272088aa-31e7-465f-a224-b49f3a86497c could not be found. Aug 03 19:04:41.503101 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-29917a60-dd73-4fef-938d-e0b63d980787 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Request method failure captured: Aug 03 19:04:41.503101 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: request: DELETE /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c HTTP/1.1 Aug 03 19:04:41.503101 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept: application/json Aug 03 19:04:41.503101 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept-Encoding: identity Aug 03 19:04:41.503101 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Connection: close Aug 03 19:04:41.503101 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Length: 0 Aug 03 19:04:41.503101 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Type: application/json Aug 03 19:04:41.503101 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Host: 10.222.0.77 Aug 03 19:04:41.503101 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Openstack-System-Scope: None Aug 03 19:04:41.503101 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: User-Agent: python-urllib3/1.26.11 Aug 03 19:04:41.503101 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Auth-Token: gAAAAABi6sZrkD-bAKl1IUEDp4h0mSyE1Y7UfQQtEn8ICwc5D87va9OO-PsXOZWD2NDQ0dBbJSJ_i_TtCz5oVPqON2SoSZ5ogGsbi7blSn37UThIH7n4R9vM0N1AuAg2OVyXbI1s579OrYDffEkNOlZvTZ4_g19BY4sUOxA6QMb3uE-62h_9U1M Aug 03 19:04:41.503101 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Id: None Aug 03 19:04:41.503101 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Name: None Aug 03 19:04:41.503101 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Identity-Status: Confirmed Aug 03 19:04:41.503101 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Is-Admin-Project: True Aug 03 19:04:41.503101 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Id: default Aug 03 19:04:41.503101 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Name: Default Aug 03 19:04:41.503101 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Id: ee13f75b9c99495cb17bb8f88590a029 Aug 03 19:04:41.503101 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Name: tempest-DeleteServersTestJSON-1823572287 Aug 03 19:04:41.503101 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Role: reader,member Aug 03 19:04:41.503101 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Roles: reader,member Aug 03 19:04:41.505442 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_ee13f75b9c99495cb17bb8f88590a029", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/ee13f75b9c99495cb17bb8f88590a029"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/ee13f75b9c99495cb17bb8f88590a029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/ee13f75b9c99495cb17bb8f88590a029"}]}] Aug 03 19:04:41.505442 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant: tempest-DeleteServersTestJSON-1823572287 Aug 03 19:04:41.505442 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Id: ee13f75b9c99495cb17bb8f88590a029 Aug 03 19:04:41.505442 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Name: tempest-DeleteServersTestJSON-1823572287 Aug 03 19:04:41.505442 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User: tempest-DeleteServersTestJSON-1823572287-project Aug 03 19:04:41.505442 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Id: default Aug 03 19:04:41.505442 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Name: Default Aug 03 19:04:41.505442 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Id: 52859bea3baf4e968e49df4e4d4aecf0 Aug 03 19:04:41.505442 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Name: tempest-DeleteServersTestJSON-1823572287-project Aug 03 19:04:41.505442 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: method: > Aug 03 19:04:41.505442 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: exception: Instance 272088aa-31e7-465f-a224-b49f3a86497c could not be found. Aug 03 19:04:41.505442 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: action_args: {'id': '272088aa-31e7-465f-a224-b49f3a86497c'} Aug 03 19:04:41.507875 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:04:41.507875 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:04:41.507875 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:04:41.507875 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:04:41.507875 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:04:41.507875 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:04:41.507875 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:04:41.507875 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:04:41.507875 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:04:41.507875 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:04:41.507875 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 272088aa-31e7-465f-a224-b49f3a86497c could not be found. Aug 03 19:04:41.507875 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:04:41.507875 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:04:41.507875 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:04:41.507875 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:04:41.507875 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:04:41.507875 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:04:41.507875 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:04:41.507875 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:04:41.507875 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:04:41.509477 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:04:41.509477 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 19:04:41.509477 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 19:04:41.509477 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 19:04:41.509477 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 19:04:41.509477 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:04:41.509477 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:04:41.509477 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:04:41.509477 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:04:41.509477 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 272088aa-31e7-465f-a224-b49f3a86497c could not be found. Aug 03 19:04:41.509477 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:04:41.509477 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:04:41.509477 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:04:41.509477 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:04:41.509477 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:04:41.509477 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:04:41.509477 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:04:41.509477 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:04:41.509477 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 272088aa-31e7-465f-a224-b49f3a86497c could not be found. Aug 03 19:04:41.509477 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:04:41.512685 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-29917a60-dd73-4fef-938d-e0b63d980787 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Returning 404 to user: Instance 272088aa-31e7-465f-a224-b49f3a86497c could not be found. {{(pid=118302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:04:41.512685 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-29917a60-dd73-4fef-938d-e0b63d980787 tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "DELETE /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 404 len: 111 microversion: 2.1 time: 0.040284 Aug 03 19:04:41.512685 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 104/214] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 3 19:04:41 2022] DELETE /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:04:41.516097 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-3a811056-5db7-4b7d-9575-f79b6f232a1c tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:41.516097 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-3a811056-5db7-4b7d-9575-f79b6f232a1c tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] [instance: 272088aa-31e7-465f-a224-b49f3a86497c] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:41.525162 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3a811056-5db7-4b7d-9575-f79b6f232a1c tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:41.525975 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3a811056-5db7-4b7d-9575-f79b6f232a1c tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:41.527424 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3a811056-5db7-4b7d-9575-f79b6f232a1c tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:41.528190 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3a811056-5db7-4b7d-9575-f79b6f232a1c tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:41.571359 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.wsgi [None req-3a811056-5db7-4b7d-9575-f79b6f232a1c tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] HTTP exception thrown: Instance 272088aa-31e7-465f-a224-b49f3a86497c could not be found. Aug 03 19:04:41.580789 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-3a811056-5db7-4b7d-9575-f79b6f232a1c tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Request method failure captured: Aug 03 19:04:41.580789 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: request: GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c HTTP/1.1 Aug 03 19:04:41.580789 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept: application/json Aug 03 19:04:41.580789 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept-Encoding: identity Aug 03 19:04:41.580789 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Connection: close Aug 03 19:04:41.580789 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Length: 0 Aug 03 19:04:41.580789 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Type: application/json Aug 03 19:04:41.580789 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Host: 10.222.0.77 Aug 03 19:04:41.580789 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Openstack-System-Scope: None Aug 03 19:04:41.580789 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: User-Agent: python-urllib3/1.26.11 Aug 03 19:04:41.580789 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Auth-Token: gAAAAABi6sZrkD-bAKl1IUEDp4h0mSyE1Y7UfQQtEn8ICwc5D87va9OO-PsXOZWD2NDQ0dBbJSJ_i_TtCz5oVPqON2SoSZ5ogGsbi7blSn37UThIH7n4R9vM0N1AuAg2OVyXbI1s579OrYDffEkNOlZvTZ4_g19BY4sUOxA6QMb3uE-62h_9U1M Aug 03 19:04:41.580789 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Id: None Aug 03 19:04:41.580789 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Name: None Aug 03 19:04:41.580789 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Identity-Status: Confirmed Aug 03 19:04:41.580789 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Is-Admin-Project: True Aug 03 19:04:41.580789 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Id: default Aug 03 19:04:41.580789 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Name: Default Aug 03 19:04:41.580789 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Id: ee13f75b9c99495cb17bb8f88590a029 Aug 03 19:04:41.580789 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Name: tempest-DeleteServersTestJSON-1823572287 Aug 03 19:04:41.580789 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Role: reader,member Aug 03 19:04:41.580789 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Roles: reader,member Aug 03 19:04:41.583494 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_ee13f75b9c99495cb17bb8f88590a029", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/ee13f75b9c99495cb17bb8f88590a029"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/ee13f75b9c99495cb17bb8f88590a029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/ee13f75b9c99495cb17bb8f88590a029"}]}] Aug 03 19:04:41.583494 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant: tempest-DeleteServersTestJSON-1823572287 Aug 03 19:04:41.583494 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Id: ee13f75b9c99495cb17bb8f88590a029 Aug 03 19:04:41.583494 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Name: tempest-DeleteServersTestJSON-1823572287 Aug 03 19:04:41.583494 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User: tempest-DeleteServersTestJSON-1823572287-project Aug 03 19:04:41.583494 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Id: default Aug 03 19:04:41.583494 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Name: Default Aug 03 19:04:41.583494 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Id: 52859bea3baf4e968e49df4e4d4aecf0 Aug 03 19:04:41.583494 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Name: tempest-DeleteServersTestJSON-1823572287-project Aug 03 19:04:41.583494 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: method: > Aug 03 19:04:41.583494 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: exception: Instance 272088aa-31e7-465f-a224-b49f3a86497c could not be found. Aug 03 19:04:41.583494 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: action_args: {'id': '272088aa-31e7-465f-a224-b49f3a86497c'} Aug 03 19:04:41.585097 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:04:41.585097 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:04:41.585097 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:04:41.585097 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:04:41.585097 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:04:41.585097 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:04:41.585097 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:04:41.585097 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:04:41.585097 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:04:41.585097 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:04:41.585097 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 272088aa-31e7-465f-a224-b49f3a86497c could not be found. Aug 03 19:04:41.585097 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:04:41.585097 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:04:41.585097 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:04:41.585097 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:04:41.585097 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:04:41.585097 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:04:41.585097 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:04:41.585097 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:04:41.585097 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:04:41.586569 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:04:41.586569 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:04:41.586569 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:04:41.586569 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:04:41.586569 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:04:41.586569 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:04:41.586569 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:04:41.586569 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 272088aa-31e7-465f-a224-b49f3a86497c could not be found. Aug 03 19:04:41.586569 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:04:41.586569 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:04:41.586569 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:04:41.586569 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:04:41.586569 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:04:41.586569 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:04:41.586569 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:04:41.586569 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:04:41.586569 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 272088aa-31e7-465f-a224-b49f3a86497c could not be found. Aug 03 19:04:41.586569 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:04:41.591510 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-3a811056-5db7-4b7d-9575-f79b6f232a1c tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] Returning 404 to user: Instance 272088aa-31e7-465f-a224-b49f3a86497c could not be found. {{(pid=118303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:04:41.596887 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-3a811056-5db7-4b7d-9575-f79b6f232a1c tempest-DeleteServersTestJSON-1823572287 tempest-DeleteServersTestJSON-1823572287-project] 10.222.0.77 "GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c" status: 404 len: 111 microversion: 2.1 time: 0.084648 Aug 03 19:04:41.598118 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 111/215] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:41 2022] GET /compute/v2.1/servers/272088aa-31e7-465f-a224-b49f3a86497c => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:04:42.040477 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-264e68f6-c793-42da-a9d6-c3e99d1c40f3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:42.042353 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-264e68f6-c793-42da-a9d6-c3e99d1c40f3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:42.061420 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-264e68f6-c793-42da-a9d6-c3e99d1c40f3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:42.062312 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-264e68f6-c793-42da-a9d6-c3e99d1c40f3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:42.063838 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-264e68f6-c793-42da-a9d6-c3e99d1c40f3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:42.064678 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-264e68f6-c793-42da-a9d6-c3e99d1c40f3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:42.369452 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-264e68f6-c793-42da-a9d6-c3e99d1c40f3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:42.392989 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-264e68f6-c793-42da-a9d6-c3e99d1c40f3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1522 microversion: 2.1 time: 0.356810 Aug 03 19:04:42.399890 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 105/216] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:42 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1522 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:43.419967 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-01f80fa5-0a42-4887-aa76-5ecb5c992624 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:43.421010 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-01f80fa5-0a42-4887-aa76-5ecb5c992624 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:43.432812 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-01f80fa5-0a42-4887-aa76-5ecb5c992624 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:43.433783 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-01f80fa5-0a42-4887-aa76-5ecb5c992624 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:43.434821 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-01f80fa5-0a42-4887-aa76-5ecb5c992624 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:43.435307 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-01f80fa5-0a42-4887-aa76-5ecb5c992624 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:43.693833 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-01f80fa5-0a42-4887-aa76-5ecb5c992624 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:43.719829 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-01f80fa5-0a42-4887-aa76-5ecb5c992624 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1522 microversion: 2.1 time: 0.305858 Aug 03 19:04:43.746904 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 112/217] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:43 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1522 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:04:44.752226 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-6e078d97-0f48-4730-84ea-a7a8914bef40 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:44.752932 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-6e078d97-0f48-4730-84ea-a7a8914bef40 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:44.759834 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-6e078d97-0f48-4730-84ea-a7a8914bef40 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:44.764256 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-6e078d97-0f48-4730-84ea-a7a8914bef40 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:44.765137 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-6e078d97-0f48-4730-84ea-a7a8914bef40 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:44.765799 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-6e078d97-0f48-4730-84ea-a7a8914bef40 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:44.801156 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:04:45.100372 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-6e078d97-0f48-4730-84ea-a7a8914bef40 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:45.112931 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-6e078d97-0f48-4730-84ea-a7a8914bef40 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1522 microversion: 2.1 time: 0.364524 Aug 03 19:04:45.114384 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 106/218] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:44 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1522 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:46.161644 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-82ee288a-7a7f-4f9a-a7ca-ddd32dcf8396 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:46.163069 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-82ee288a-7a7f-4f9a-a7ca-ddd32dcf8396 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:46.172094 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-82ee288a-7a7f-4f9a-a7ca-ddd32dcf8396 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:46.172944 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-82ee288a-7a7f-4f9a-a7ca-ddd32dcf8396 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:46.173916 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-82ee288a-7a7f-4f9a-a7ca-ddd32dcf8396 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:46.174352 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-82ee288a-7a7f-4f9a-a7ca-ddd32dcf8396 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:46.376809 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-82ee288a-7a7f-4f9a-a7ca-ddd32dcf8396 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:46.393364 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-82ee288a-7a7f-4f9a-a7ca-ddd32dcf8396 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1522 microversion: 2.1 time: 0.260116 Aug 03 19:04:46.393982 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 113/219] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:46 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:47.438755 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-add89053-e114-4f2e-9fb8-ba79e73c7b04 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:47.439767 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-add89053-e114-4f2e-9fb8-ba79e73c7b04 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:47.461903 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-add89053-e114-4f2e-9fb8-ba79e73c7b04 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:47.462839 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-add89053-e114-4f2e-9fb8-ba79e73c7b04 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:47.464105 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-add89053-e114-4f2e-9fb8-ba79e73c7b04 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:47.464105 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-add89053-e114-4f2e-9fb8-ba79e73c7b04 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:47.950924 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-add89053-e114-4f2e-9fb8-ba79e73c7b04 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:47.968816 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-add89053-e114-4f2e-9fb8-ba79e73c7b04 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1522 microversion: 2.1 time: 0.541998 Aug 03 19:04:47.970597 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 107/220] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:47 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1522 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:49.003914 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-ff400b26-30e0-4aa6-9b79-72c0e0fd6d78 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:49.004621 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-ff400b26-30e0-4aa6-9b79-72c0e0fd6d78 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:49.025340 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ff400b26-30e0-4aa6-9b79-72c0e0fd6d78 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:49.026807 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ff400b26-30e0-4aa6-9b79-72c0e0fd6d78 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:49.028346 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ff400b26-30e0-4aa6-9b79-72c0e0fd6d78 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:49.035168 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ff400b26-30e0-4aa6-9b79-72c0e0fd6d78 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:49.470926 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-ff400b26-30e0-4aa6-9b79-72c0e0fd6d78 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:49.499628 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-ff400b26-30e0-4aa6-9b79-72c0e0fd6d78 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1522 microversion: 2.1 time: 0.500292 Aug 03 19:04:49.511176 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 114/221] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:48 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1522 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:50.536738 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-3b9ae537-45ca-4112-b127-8b3dcecf28d3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:50.538187 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-3b9ae537-45ca-4112-b127-8b3dcecf28d3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:50.546797 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3b9ae537-45ca-4112-b127-8b3dcecf28d3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:50.547307 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3b9ae537-45ca-4112-b127-8b3dcecf28d3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:50.548090 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3b9ae537-45ca-4112-b127-8b3dcecf28d3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:50.548527 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3b9ae537-45ca-4112-b127-8b3dcecf28d3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:50.741675 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-3b9ae537-45ca-4112-b127-8b3dcecf28d3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:50.753148 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-3b9ae537-45ca-4112-b127-8b3dcecf28d3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1522 microversion: 2.1 time: 0.223356 Aug 03 19:04:50.753843 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 108/222] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:50 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:51.776102 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-be1c9e85-8faf-4462-98a7-61378c13277c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:51.777384 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-be1c9e85-8faf-4462-98a7-61378c13277c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:51.792238 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-be1c9e85-8faf-4462-98a7-61378c13277c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:51.792932 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-be1c9e85-8faf-4462-98a7-61378c13277c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:51.795969 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-be1c9e85-8faf-4462-98a7-61378c13277c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:51.796718 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-be1c9e85-8faf-4462-98a7-61378c13277c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:51.968268 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-be1c9e85-8faf-4462-98a7-61378c13277c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:51.991561 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-be1c9e85-8faf-4462-98a7-61378c13277c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1522 microversion: 2.1 time: 0.219101 Aug 03 19:04:51.992715 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 115/223] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:51 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:53.016809 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-6ced71b7-18d8-4d83-bd4e-4995409c06da tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:53.017614 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-6ced71b7-18d8-4d83-bd4e-4995409c06da tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:53.027682 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-6ced71b7-18d8-4d83-bd4e-4995409c06da tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:53.028457 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-6ced71b7-18d8-4d83-bd4e-4995409c06da tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:53.029323 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-6ced71b7-18d8-4d83-bd4e-4995409c06da tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:53.029933 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-6ced71b7-18d8-4d83-bd4e-4995409c06da tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:53.233883 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-6ced71b7-18d8-4d83-bd4e-4995409c06da tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:53.249379 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-6ced71b7-18d8-4d83-bd4e-4995409c06da tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1522 microversion: 2.1 time: 0.237817 Aug 03 19:04:53.259915 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 109/224] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:53 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:54.278099 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-24c329c0-34bb-4616-bd97-100dc344d54c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:54.279230 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-24c329c0-34bb-4616-bd97-100dc344d54c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:54.289480 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-24c329c0-34bb-4616-bd97-100dc344d54c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:54.290217 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-24c329c0-34bb-4616-bd97-100dc344d54c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:54.291992 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-24c329c0-34bb-4616-bd97-100dc344d54c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:54.292930 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-24c329c0-34bb-4616-bd97-100dc344d54c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:54.470430 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-24c329c0-34bb-4616-bd97-100dc344d54c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:54.481980 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-24c329c0-34bb-4616-bd97-100dc344d54c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1522 microversion: 2.1 time: 0.210911 Aug 03 19:04:54.484957 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 116/225] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:54 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:04:55.505900 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-da871a98-eabd-465b-b60d-db69944a3c25 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:55.506597 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-da871a98-eabd-465b-b60d-db69944a3c25 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:55.514928 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-da871a98-eabd-465b-b60d-db69944a3c25 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:55.515483 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-da871a98-eabd-465b-b60d-db69944a3c25 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:55.516482 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-da871a98-eabd-465b-b60d-db69944a3c25 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:55.517185 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-da871a98-eabd-465b-b60d-db69944a3c25 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:55.742689 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-da871a98-eabd-465b-b60d-db69944a3c25 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:55.751365 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-da871a98-eabd-465b-b60d-db69944a3c25 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1522 microversion: 2.1 time: 0.249195 Aug 03 19:04:55.751967 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 110/226] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:55 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:56.784978 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-9115cb3f-483b-47f8-86ac-8a950adb12f3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:56.785912 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-9115cb3f-483b-47f8-86ac-8a950adb12f3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:56.793099 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9115cb3f-483b-47f8-86ac-8a950adb12f3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:56.793877 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9115cb3f-483b-47f8-86ac-8a950adb12f3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:56.794938 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9115cb3f-483b-47f8-86ac-8a950adb12f3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:56.795538 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9115cb3f-483b-47f8-86ac-8a950adb12f3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:57.019161 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-9115cb3f-483b-47f8-86ac-8a950adb12f3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:57.029564 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-9115cb3f-483b-47f8-86ac-8a950adb12f3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1502 microversion: 2.1 time: 0.249287 Aug 03 19:04:57.030657 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 117/227] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:56 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1502 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:57.068669 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-0ac88ddc-aad8-474b-8988-88b4fe65c04b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:57.069475 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-0ac88ddc-aad8-474b-8988-88b4fe65c04b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:57.076778 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0ac88ddc-aad8-474b-8988-88b4fe65c04b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:57.077225 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0ac88ddc-aad8-474b-8988-88b4fe65c04b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:57.078022 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0ac88ddc-aad8-474b-8988-88b4fe65c04b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:57.078455 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0ac88ddc-aad8-474b-8988-88b4fe65c04b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:57.268276 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-0ac88ddc-aad8-474b-8988-88b4fe65c04b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:57.278578 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-0ac88ddc-aad8-474b-8988-88b4fe65c04b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a" status: 200 len: 1516 microversion: 2.1 time: 0.225714 Aug 03 19:04:57.279190 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 111/228] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:57 2022] GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a => generated 1516 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:05:01.982016 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-883c3b16-4591-41be-bace-f0345b347bc9 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:05:01.985992 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-883c3b16-4591-41be-bace-f0345b347bc9 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:01.997638 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-883c3b16-4591-41be-bace-f0345b347bc9 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:01.998140 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-883c3b16-4591-41be-bace-f0345b347bc9 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:01.999156 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-883c3b16-4591-41be-bace-f0345b347bc9 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:01.999753 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-883c3b16-4591-41be-bace-f0345b347bc9 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:02.048152 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.objects.instance [None req-883c3b16-4591-41be-bace-f0345b347bc9 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lazy-loading 'flavor' on Instance uuid 82aa6775-8d66-4d67-af69-104454485a2a {{(pid=118303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:05:02.636084 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-883c3b16-4591-41be-bace-f0345b347bc9 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "POST /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a/action" status: 200 len: 32 microversion: 2.1 time: 0.663128 Aug 03 19:05:02.641248 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 118/229] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 3 19:05:01 2022] POST /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a/action => generated 32 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 03 19:05:02.648845 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-a0015d0e-0290-4faf-bc45-f53aac419b27 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:02.649508 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-a0015d0e-0290-4faf-bc45-f53aac419b27 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:02.659778 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a0015d0e-0290-4faf-bc45-f53aac419b27 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:02.660504 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a0015d0e-0290-4faf-bc45-f53aac419b27 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:02.661750 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a0015d0e-0290-4faf-bc45-f53aac419b27 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:02.662454 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a0015d0e-0290-4faf-bc45-f53aac419b27 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:02.839604 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-a0015d0e-0290-4faf-bc45-f53aac419b27 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:05:02.847706 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-a0015d0e-0290-4faf-bc45-f53aac419b27 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a" status: 200 len: 1522 microversion: 2.1 time: 0.205031 Aug 03 19:05:02.850117 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 112/230] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:02 2022] GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:05:03.871072 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-72fd1955-1187-424d-bd3b-883dd0ea918b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:03.872504 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-72fd1955-1187-424d-bd3b-883dd0ea918b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:03.880430 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-72fd1955-1187-424d-bd3b-883dd0ea918b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:03.880868 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-72fd1955-1187-424d-bd3b-883dd0ea918b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:03.881645 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-72fd1955-1187-424d-bd3b-883dd0ea918b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:03.882072 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-72fd1955-1187-424d-bd3b-883dd0ea918b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:04.046025 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-72fd1955-1187-424d-bd3b-883dd0ea918b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:05:04.055482 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-72fd1955-1187-424d-bd3b-883dd0ea918b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a" status: 200 len: 1522 microversion: 2.1 time: 0.188815 Aug 03 19:05:04.058623 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 119/231] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:03 2022] GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:05:05.084503 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-db20bfbe-b56d-474c-a274-9236bb561e93 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:05.085176 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-db20bfbe-b56d-474c-a274-9236bb561e93 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:05.093813 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-db20bfbe-b56d-474c-a274-9236bb561e93 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:05.094275 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-db20bfbe-b56d-474c-a274-9236bb561e93 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:05.095241 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-db20bfbe-b56d-474c-a274-9236bb561e93 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:05.095708 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-db20bfbe-b56d-474c-a274-9236bb561e93 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:05.271859 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-db20bfbe-b56d-474c-a274-9236bb561e93 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:05:05.282881 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-db20bfbe-b56d-474c-a274-9236bb561e93 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a" status: 200 len: 1522 microversion: 2.1 time: 0.202834 Aug 03 19:05:05.283684 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 113/232] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:05 2022] GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:05:06.322251 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-9e44bc0e-50a6-4dd9-9388-22e1bcce1db5 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:06.322251 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-9e44bc0e-50a6-4dd9-9388-22e1bcce1db5 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:06.323625 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9e44bc0e-50a6-4dd9-9388-22e1bcce1db5 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:06.324049 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9e44bc0e-50a6-4dd9-9388-22e1bcce1db5 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:06.324976 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9e44bc0e-50a6-4dd9-9388-22e1bcce1db5 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:06.325444 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9e44bc0e-50a6-4dd9-9388-22e1bcce1db5 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:06.480364 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-9e44bc0e-50a6-4dd9-9388-22e1bcce1db5 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:05:06.490271 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-9e44bc0e-50a6-4dd9-9388-22e1bcce1db5 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a" status: 200 len: 1522 microversion: 2.1 time: 0.179711 Aug 03 19:05:06.496518 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 120/233] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:06 2022] GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:05:07.530010 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-3a2c7a7d-57b5-485b-8a71-8b06dfc93476 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:07.530827 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-3a2c7a7d-57b5-485b-8a71-8b06dfc93476 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:07.548117 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3a2c7a7d-57b5-485b-8a71-8b06dfc93476 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:07.548698 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3a2c7a7d-57b5-485b-8a71-8b06dfc93476 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:07.549513 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3a2c7a7d-57b5-485b-8a71-8b06dfc93476 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:07.549989 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3a2c7a7d-57b5-485b-8a71-8b06dfc93476 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:07.745657 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-3a2c7a7d-57b5-485b-8a71-8b06dfc93476 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:05:07.767819 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-3a2c7a7d-57b5-485b-8a71-8b06dfc93476 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a" status: 200 len: 1522 microversion: 2.1 time: 0.243650 Aug 03 19:05:07.784123 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 114/234] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:07 2022] GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:05:08.809645 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-41954148-ab46-43b0-b185-935fa1fe673c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:08.814132 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-41954148-ab46-43b0-b185-935fa1fe673c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:08.814516 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_api:SELECT=30 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:05:08.823688 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-41954148-ab46-43b0-b185-935fa1fe673c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:08.824471 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-41954148-ab46-43b0-b185-935fa1fe673c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:08.825836 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-41954148-ab46-43b0-b185-935fa1fe673c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:08.826588 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-41954148-ab46-43b0-b185-935fa1fe673c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:08.856313 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:05:09.054193 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-41954148-ab46-43b0-b185-935fa1fe673c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:05:09.063112 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-41954148-ab46-43b0-b185-935fa1fe673c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a" status: 200 len: 1522 microversion: 2.1 time: 0.261996 Aug 03 19:05:09.063803 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 121/235] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:08 2022] GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:05:10.085912 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-d3e44d2e-b8d9-478d-bde1-f006de079677 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:10.086496 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-d3e44d2e-b8d9-478d-bde1-f006de079677 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:10.088991 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_api:SELECT=36 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:05:10.094255 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d3e44d2e-b8d9-478d-bde1-f006de079677 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:10.094781 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d3e44d2e-b8d9-478d-bde1-f006de079677 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:10.096062 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d3e44d2e-b8d9-478d-bde1-f006de079677 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:10.096515 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d3e44d2e-b8d9-478d-bde1-f006de079677 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:10.294512 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-d3e44d2e-b8d9-478d-bde1-f006de079677 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:05:10.302732 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-d3e44d2e-b8d9-478d-bde1-f006de079677 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a" status: 200 len: 1522 microversion: 2.1 time: 0.220682 Aug 03 19:05:10.303367 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 115/236] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:10 2022] GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:05:11.326210 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-aea25c4f-c169-4413-9646-3c5ed42ea330 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:11.327455 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-aea25c4f-c169-4413-9646-3c5ed42ea330 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:11.333978 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-aea25c4f-c169-4413-9646-3c5ed42ea330 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:11.334427 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-aea25c4f-c169-4413-9646-3c5ed42ea330 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:11.335229 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-aea25c4f-c169-4413-9646-3c5ed42ea330 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:11.335698 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-aea25c4f-c169-4413-9646-3c5ed42ea330 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:11.485482 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-aea25c4f-c169-4413-9646-3c5ed42ea330 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:05:11.493463 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-aea25c4f-c169-4413-9646-3c5ed42ea330 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a" status: 200 len: 1522 microversion: 2.1 time: 0.172702 Aug 03 19:05:11.494119 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 122/237] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:11 2022] GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:05:12.519820 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-dfa2e540-201c-47a1-9987-1d160bd3981d tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:12.520925 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-dfa2e540-201c-47a1-9987-1d160bd3981d tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:12.533418 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-dfa2e540-201c-47a1-9987-1d160bd3981d tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:12.534197 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-dfa2e540-201c-47a1-9987-1d160bd3981d tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:12.535563 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-dfa2e540-201c-47a1-9987-1d160bd3981d tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:12.536322 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-dfa2e540-201c-47a1-9987-1d160bd3981d tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:12.716619 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-dfa2e540-201c-47a1-9987-1d160bd3981d tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:05:12.725240 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-dfa2e540-201c-47a1-9987-1d160bd3981d tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a" status: 200 len: 1522 microversion: 2.1 time: 0.212640 Aug 03 19:05:12.726255 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 116/238] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:12 2022] GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:05:13.755711 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-741f8d7c-6e48-4822-a336-a70c34246173 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:13.756470 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-741f8d7c-6e48-4822-a336-a70c34246173 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:13.780558 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-741f8d7c-6e48-4822-a336-a70c34246173 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:13.781510 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-741f8d7c-6e48-4822-a336-a70c34246173 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:13.782385 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-741f8d7c-6e48-4822-a336-a70c34246173 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:13.783066 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-741f8d7c-6e48-4822-a336-a70c34246173 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:13.946661 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-741f8d7c-6e48-4822-a336-a70c34246173 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:05:13.956193 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-741f8d7c-6e48-4822-a336-a70c34246173 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a" status: 200 len: 1522 microversion: 2.1 time: 0.205509 Aug 03 19:05:13.956806 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 123/239] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:13 2022] GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:05:14.977819 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-8ad4b510-1c4e-4652-a599-4db7d2edb937 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:14.978460 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-8ad4b510-1c4e-4652-a599-4db7d2edb937 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:14.985329 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8ad4b510-1c4e-4652-a599-4db7d2edb937 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:14.985811 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8ad4b510-1c4e-4652-a599-4db7d2edb937 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:14.986550 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8ad4b510-1c4e-4652-a599-4db7d2edb937 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:14.987080 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8ad4b510-1c4e-4652-a599-4db7d2edb937 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:15.149496 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-8ad4b510-1c4e-4652-a599-4db7d2edb937 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:05:15.161094 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-8ad4b510-1c4e-4652-a599-4db7d2edb937 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a" status: 200 len: 1522 microversion: 2.1 time: 0.187129 Aug 03 19:05:15.161786 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 117/240] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:14 2022] GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:05:16.184207 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-31f8e697-941d-4bbc-91ae-bbe0ee3c0ba8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:16.185033 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-31f8e697-941d-4bbc-91ae-bbe0ee3c0ba8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:16.192000 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-31f8e697-941d-4bbc-91ae-bbe0ee3c0ba8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:16.192522 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-31f8e697-941d-4bbc-91ae-bbe0ee3c0ba8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:16.193376 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-31f8e697-941d-4bbc-91ae-bbe0ee3c0ba8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:16.193884 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-31f8e697-941d-4bbc-91ae-bbe0ee3c0ba8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:16.358084 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-31f8e697-941d-4bbc-91ae-bbe0ee3c0ba8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:05:16.366921 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-31f8e697-941d-4bbc-91ae-bbe0ee3c0ba8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a" status: 200 len: 1522 microversion: 2.1 time: 0.187264 Aug 03 19:05:16.367733 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 124/241] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:16 2022] GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:05:17.392500 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-87fbe91b-eb8f-4e06-86f4-c348cf45d8ed tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:17.392500 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-87fbe91b-eb8f-4e06-86f4-c348cf45d8ed tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:17.403982 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-87fbe91b-eb8f-4e06-86f4-c348cf45d8ed tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:17.404517 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-87fbe91b-eb8f-4e06-86f4-c348cf45d8ed tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:17.406041 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-87fbe91b-eb8f-4e06-86f4-c348cf45d8ed tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:17.406692 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-87fbe91b-eb8f-4e06-86f4-c348cf45d8ed tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:17.584341 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-87fbe91b-eb8f-4e06-86f4-c348cf45d8ed tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:05:17.593968 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-87fbe91b-eb8f-4e06-86f4-c348cf45d8ed tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a" status: 200 len: 1522 microversion: 2.1 time: 0.209295 Aug 03 19:05:17.594495 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 118/242] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:17 2022] GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:05:18.620911 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-3c41f99e-4a66-4e28-9d27-c35abda5a347 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:18.621733 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-3c41f99e-4a66-4e28-9d27-c35abda5a347 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:18.630976 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3c41f99e-4a66-4e28-9d27-c35abda5a347 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:18.631446 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3c41f99e-4a66-4e28-9d27-c35abda5a347 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:18.632290 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3c41f99e-4a66-4e28-9d27-c35abda5a347 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:18.634446 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3c41f99e-4a66-4e28-9d27-c35abda5a347 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:18.793107 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-3c41f99e-4a66-4e28-9d27-c35abda5a347 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:05:18.802112 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-3c41f99e-4a66-4e28-9d27-c35abda5a347 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a" status: 200 len: 1522 microversion: 2.1 time: 0.186107 Aug 03 19:05:18.802970 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 125/243] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:18 2022] GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:05:19.824104 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-0f689858-ba40-4882-a36f-e250c813be43 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:19.824869 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-0f689858-ba40-4882-a36f-e250c813be43 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:19.831609 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0f689858-ba40-4882-a36f-e250c813be43 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:19.832087 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0f689858-ba40-4882-a36f-e250c813be43 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:19.832877 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0f689858-ba40-4882-a36f-e250c813be43 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:19.833312 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0f689858-ba40-4882-a36f-e250c813be43 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:19.977774 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-0f689858-ba40-4882-a36f-e250c813be43 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:05:19.991094 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-0f689858-ba40-4882-a36f-e250c813be43 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a" status: 200 len: 1522 microversion: 2.1 time: 0.170657 Aug 03 19:05:19.992099 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 119/244] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:19 2022] GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:05:21.019420 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-e740a393-5697-4c9d-bef7-76863120e0d2 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:21.020289 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-e740a393-5697-4c9d-bef7-76863120e0d2 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:21.030257 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e740a393-5697-4c9d-bef7-76863120e0d2 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:21.031264 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e740a393-5697-4c9d-bef7-76863120e0d2 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:21.032443 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e740a393-5697-4c9d-bef7-76863120e0d2 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:21.032878 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e740a393-5697-4c9d-bef7-76863120e0d2 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:21.177744 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-e740a393-5697-4c9d-bef7-76863120e0d2 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:05:21.186283 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-e740a393-5697-4c9d-bef7-76863120e0d2 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a" status: 200 len: 1502 microversion: 2.1 time: 0.172434 Aug 03 19:05:21.187257 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 126/245] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:21 2022] GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a => generated 1502 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:05:21.209291 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-eb011605-df85-4c58-b3ea-e9f57a0d97d8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9fc33de7-140c-4a2c-8cfc-a6dc5b62da0f"}} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:05:21.211923 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-eb011605-df85-4c58-b3ea-e9f57a0d97d8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:21.220164 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-eb011605-df85-4c58-b3ea-e9f57a0d97d8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:21.220611 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-eb011605-df85-4c58-b3ea-e9f57a0d97d8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:21.221600 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-eb011605-df85-4c58-b3ea-e9f57a0d97d8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:21.222222 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-eb011605-df85-4c58-b3ea-e9f57a0d97d8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:21.249378 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.wsgi [None req-eb011605-df85-4c58-b3ea-e9f57a0d97d8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] HTTP exception thrown: Cannot 'attach_volume' instance 82aa6775-8d66-4d67-af69-104454485a2a while it is in vm_state rescued Aug 03 19:05:21.251217 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-eb011605-df85-4c58-b3ea-e9f57a0d97d8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Request method failure captured: Aug 03 19:05:21.251217 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: request: POST /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a/os-volume_attachments HTTP/1.1 Aug 03 19:05:21.251217 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept: application/json Aug 03 19:05:21.251217 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept-Encoding: identity Aug 03 19:05:21.251217 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Connection: close Aug 03 19:05:21.251217 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Length: 74 Aug 03 19:05:21.251217 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Type: application/json Aug 03 19:05:21.251217 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Host: 10.222.0.77 Aug 03 19:05:21.251217 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Openstack-System-Scope: None Aug 03 19:05:21.251217 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: User-Agent: python-urllib3/1.26.11 Aug 03 19:05:21.251217 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Auth-Token: gAAAAABi6sZpW7w7YQZ3ICnejTi_VA0idBlfsSFO1OcVhcF8hcGMcBJoz1L9T5T64xxPIqj2mDSnq3haUv8vF_XUJoqHhvqS8KjotAxSwLqgNhIXH7oXp4pMLcBvPDn6dBXb26JYx8SgQOYpnZ_y7iEMNLg6DSgl3Ss3QzdBRQ8W6OiIonlfjz4 Aug 03 19:05:21.251217 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Id: None Aug 03 19:05:21.251217 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Name: None Aug 03 19:05:21.251217 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Identity-Status: Confirmed Aug 03 19:05:21.251217 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Is-Admin-Project: True Aug 03 19:05:21.251217 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Id: default Aug 03 19:05:21.251217 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Name: Default Aug 03 19:05:21.251217 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Id: bf009469f935465baa6427ab4951944e Aug 03 19:05:21.251217 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1404930254 Aug 03 19:05:21.251217 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Role: reader,member Aug 03 19:05:21.251217 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Roles: reader,member Aug 03 19:05:21.252690 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_bf009469f935465baa6427ab4951944e", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/bf009469f935465baa6427ab4951944e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/bf009469f935465baa6427ab4951944e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/bf009469f935465baa6427ab4951944e"}]}] Aug 03 19:05:21.252690 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1404930254 Aug 03 19:05:21.252690 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Id: bf009469f935465baa6427ab4951944e Aug 03 19:05:21.252690 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1404930254 Aug 03 19:05:21.252690 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User: tempest-ServerRescueNegativeTestJSON-1404930254-project Aug 03 19:05:21.252690 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Id: default Aug 03 19:05:21.252690 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Name: Default Aug 03 19:05:21.252690 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Id: 9c46900844e8483bb2dff3b9e65df372 Aug 03 19:05:21.252690 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1404930254-project Aug 03 19:05:21.252690 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Aug 03 19:05:21.252690 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: {"volumeAttachment": {"volumeId": "9fc33de7-140c-4a2c-8cfc-a6dc5b62da0f"}} Aug 03 19:05:21.252690 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: method: > Aug 03 19:05:21.253645 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: exception: Cannot 'attach_volume' instance 82aa6775-8d66-4d67-af69-104454485a2a while it is in vm_state rescued Aug 03 19:05:21.253645 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: action_args: {'server_id': '82aa6775-8d66-4d67-af69-104454485a2a', 'body': {'volumeAttachment': {'volumeId': '9fc33de7-140c-4a2c-8cfc-a6dc5b62da0f'}}} Aug 03 19:05:21.253645 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:05:21.253645 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:05:21.253645 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 03 19:05:21.253645 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 03 19:05:21.253645 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 19:05:21.253645 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 19:05:21.253645 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 03 19:05:21.253645 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 19:05:21.253645 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 82aa6775-8d66-4d67-af69-104454485a2a in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 03 19:05:21.253645 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:05:21.253645 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:05:21.253645 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:05:21.253645 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:05:21.253645 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:05:21.253645 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:05:21.253645 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:05:21.253645 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:05:21.255057 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:05:21.255057 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:05:21.255057 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 19:05:21.255057 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 19:05:21.255057 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 19:05:21.255057 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 19:05:21.255057 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 19:05:21.255057 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 19:05:21.255057 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 03 19:05:21.255057 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 03 19:05:21.255057 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 19:05:21.255057 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 19:05:21.255057 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 82aa6775-8d66-4d67-af69-104454485a2a while it is in vm_state rescued Aug 03 19:05:21.255057 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:05:21.255057 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:05:21.255057 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:05:21.255057 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:05:21.255057 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:05:21.255057 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:05:21.256873 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:05:21.256873 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:05:21.256873 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 82aa6775-8d66-4d67-af69-104454485a2a while it is in vm_state rescued Aug 03 19:05:21.256873 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:05:21.258789 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-eb011605-df85-4c58-b3ea-e9f57a0d97d8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Returning 409 to user: Cannot 'attach_volume' instance 82aa6775-8d66-4d67-af69-104454485a2a while it is in vm_state rescued {{(pid=118302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:05:21.261447 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-eb011605-df85-4c58-b3ea-e9f57a0d97d8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "POST /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.056916 Aug 03 19:05:21.262460 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 120/246] 10.222.0.77 () {60 vars in 1323 bytes} [Wed Aug 3 19:05:21 2022] POST /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a/os-volume_attachments => generated 152 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 19:05:21.282463 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-e6a16289-15ca-4768-a1a5-4155f89579d3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:05:21.283647 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-e6a16289-15ca-4768-a1a5-4155f89579d3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:21.290115 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e6a16289-15ca-4768-a1a5-4155f89579d3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:21.290572 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e6a16289-15ca-4768-a1a5-4155f89579d3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:21.292026 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e6a16289-15ca-4768-a1a5-4155f89579d3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:21.292512 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e6a16289-15ca-4768-a1a5-4155f89579d3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:21.680916 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-e6a16289-15ca-4768-a1a5-4155f89579d3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "POST /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a/action" status: 202 len: 0 microversion: 2.1 time: 0.403154 Aug 03 19:05:21.684401 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 127/247] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 3 19:05:21 2022] POST /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a/action => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 19:05:21.692131 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-82775c6c-3674-4e05-aa66-99036f605813 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:21.692746 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-82775c6c-3674-4e05-aa66-99036f605813 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:21.700167 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-82775c6c-3674-4e05-aa66-99036f605813 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:21.700608 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-82775c6c-3674-4e05-aa66-99036f605813 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:21.701392 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-82775c6c-3674-4e05-aa66-99036f605813 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:21.701826 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-82775c6c-3674-4e05-aa66-99036f605813 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:21.851520 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-82775c6c-3674-4e05-aa66-99036f605813 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:05:21.861254 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-82775c6c-3674-4e05-aa66-99036f605813 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a" status: 200 len: 1510 microversion: 2.1 time: 0.174610 Aug 03 19:05:21.862049 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 121/248] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:21 2022] GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a => generated 1510 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:05:22.886300 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-5167bd82-fe3b-4130-9225-a273f79fe0b1 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:22.887635 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-5167bd82-fe3b-4130-9225-a273f79fe0b1 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:22.894540 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5167bd82-fe3b-4130-9225-a273f79fe0b1 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:22.895175 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5167bd82-fe3b-4130-9225-a273f79fe0b1 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:22.895965 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5167bd82-fe3b-4130-9225-a273f79fe0b1 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:22.896396 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5167bd82-fe3b-4130-9225-a273f79fe0b1 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:23.049103 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-5167bd82-fe3b-4130-9225-a273f79fe0b1 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:05:23.059127 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-5167bd82-fe3b-4130-9225-a273f79fe0b1 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a" status: 200 len: 1510 microversion: 2.1 time: 0.179086 Aug 03 19:05:23.059833 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 128/249] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:22 2022] GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a => generated 1510 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:05:24.080782 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-b35820b1-2406-48ec-a40e-8df957174203 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:24.081566 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-b35820b1-2406-48ec-a40e-8df957174203 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:24.088925 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b35820b1-2406-48ec-a40e-8df957174203 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:24.089344 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b35820b1-2406-48ec-a40e-8df957174203 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:24.090115 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b35820b1-2406-48ec-a40e-8df957174203 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:24.090553 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b35820b1-2406-48ec-a40e-8df957174203 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:24.093403 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=91 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:05:24.246325 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-b35820b1-2406-48ec-a40e-8df957174203 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:05:24.254064 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-b35820b1-2406-48ec-a40e-8df957174203 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a" status: 200 len: 1510 microversion: 2.1 time: 0.177328 Aug 03 19:05:24.254643 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 122/250] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:24 2022] GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a => generated 1510 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:05:25.276132 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-6fd0c7cb-6e35-4460-ad4b-f6ce83c47f3e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:25.276767 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-6fd0c7cb-6e35-4460-ad4b-f6ce83c47f3e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:25.283331 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6fd0c7cb-6e35-4460-ad4b-f6ce83c47f3e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:25.283778 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6fd0c7cb-6e35-4460-ad4b-f6ce83c47f3e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:25.284599 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6fd0c7cb-6e35-4460-ad4b-f6ce83c47f3e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:25.285029 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6fd0c7cb-6e35-4460-ad4b-f6ce83c47f3e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:25.427711 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-6fd0c7cb-6e35-4460-ad4b-f6ce83c47f3e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:05:25.436211 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-6fd0c7cb-6e35-4460-ad4b-f6ce83c47f3e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a" status: 200 len: 1510 microversion: 2.1 time: 0.163913 Aug 03 19:05:25.436793 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 129/251] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:25 2022] GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:05:26.462634 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-2c660ce4-ef56-4d15-8cf3-890a402492bc tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:26.463332 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-2c660ce4-ef56-4d15-8cf3-890a402492bc tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:26.470383 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2c660ce4-ef56-4d15-8cf3-890a402492bc tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:26.470998 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2c660ce4-ef56-4d15-8cf3-890a402492bc tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:26.471920 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2c660ce4-ef56-4d15-8cf3-890a402492bc tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:26.472363 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2c660ce4-ef56-4d15-8cf3-890a402492bc tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:26.609974 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-2c660ce4-ef56-4d15-8cf3-890a402492bc tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:05:26.618488 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-2c660ce4-ef56-4d15-8cf3-890a402492bc tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a" status: 200 len: 1510 microversion: 2.1 time: 0.162610 Aug 03 19:05:26.619157 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 123/252] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:26 2022] GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:05:27.641548 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-e6ccb062-e8ea-41a0-8ce8-34e38aff1351 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:27.642150 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-e6ccb062-e8ea-41a0-8ce8-34e38aff1351 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:27.653225 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e6ccb062-e8ea-41a0-8ce8-34e38aff1351 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:27.653777 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e6ccb062-e8ea-41a0-8ce8-34e38aff1351 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:27.654411 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e6ccb062-e8ea-41a0-8ce8-34e38aff1351 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:27.654836 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e6ccb062-e8ea-41a0-8ce8-34e38aff1351 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:27.810581 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-e6ccb062-e8ea-41a0-8ce8-34e38aff1351 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:05:27.824269 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-e6ccb062-e8ea-41a0-8ce8-34e38aff1351 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a" status: 200 len: 1510 microversion: 2.1 time: 0.186285 Aug 03 19:05:27.825120 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 130/253] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:27 2022] GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a => generated 1510 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:05:28.855756 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-b0214171-bb78-4bf0-bb09-e3e4bde5f739 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:28.856944 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-b0214171-bb78-4bf0-bb09-e3e4bde5f739 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:28.870693 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b0214171-bb78-4bf0-bb09-e3e4bde5f739 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:28.871654 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b0214171-bb78-4bf0-bb09-e3e4bde5f739 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:28.873174 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b0214171-bb78-4bf0-bb09-e3e4bde5f739 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:28.874052 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b0214171-bb78-4bf0-bb09-e3e4bde5f739 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:29.170751 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-b0214171-bb78-4bf0-bb09-e3e4bde5f739 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:05:29.179965 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-b0214171-bb78-4bf0-bb09-e3e4bde5f739 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a" status: 200 len: 1510 microversion: 2.1 time: 0.329822 Aug 03 19:05:29.180655 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 124/254] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:28 2022] GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a => generated 1510 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:05:30.205267 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-2e79ba03-9846-4896-9c4f-90823a2264e8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:30.205905 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-2e79ba03-9846-4896-9c4f-90823a2264e8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:30.212356 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2e79ba03-9846-4896-9c4f-90823a2264e8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:30.213354 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2e79ba03-9846-4896-9c4f-90823a2264e8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:30.214394 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2e79ba03-9846-4896-9c4f-90823a2264e8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:30.214830 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2e79ba03-9846-4896-9c4f-90823a2264e8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:30.381530 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-2e79ba03-9846-4896-9c4f-90823a2264e8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:05:30.391545 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-2e79ba03-9846-4896-9c4f-90823a2264e8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a" status: 200 len: 1510 microversion: 2.1 time: 0.190449 Aug 03 19:05:30.413075 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 131/255] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:30 2022] GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a => generated 1510 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:05:31.447489 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-58eea185-2608-4583-a28f-ec1d89765532 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:31.448266 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-58eea185-2608-4583-a28f-ec1d89765532 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:31.458439 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-58eea185-2608-4583-a28f-ec1d89765532 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:31.458439 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-58eea185-2608-4583-a28f-ec1d89765532 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:31.458985 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-58eea185-2608-4583-a28f-ec1d89765532 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:31.459439 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-58eea185-2608-4583-a28f-ec1d89765532 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:31.620416 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-58eea185-2608-4583-a28f-ec1d89765532 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:05:31.632347 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-58eea185-2608-4583-a28f-ec1d89765532 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a" status: 200 len: 1510 microversion: 2.1 time: 0.194057 Aug 03 19:05:31.635399 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 125/256] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:31 2022] GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a => generated 1510 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:05:32.655100 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-631d2ece-da90-4c59-84c9-4682b3e2a368 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:32.655724 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-631d2ece-da90-4c59-84c9-4682b3e2a368 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:32.663828 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-631d2ece-da90-4c59-84c9-4682b3e2a368 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:32.664270 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-631d2ece-da90-4c59-84c9-4682b3e2a368 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:32.665048 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-631d2ece-da90-4c59-84c9-4682b3e2a368 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:32.665515 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-631d2ece-da90-4c59-84c9-4682b3e2a368 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:32.817830 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-631d2ece-da90-4c59-84c9-4682b3e2a368 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:05:32.826560 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-631d2ece-da90-4c59-84c9-4682b3e2a368 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a" status: 200 len: 1510 microversion: 2.1 time: 0.176600 Aug 03 19:05:32.827167 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 132/257] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:32 2022] GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a => generated 1510 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:05:33.848951 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-405c87ef-cfd0-48a1-8bc8-f6dc1773f02e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:33.849592 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-405c87ef-cfd0-48a1-8bc8-f6dc1773f02e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:33.859744 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-405c87ef-cfd0-48a1-8bc8-f6dc1773f02e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:33.859744 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-405c87ef-cfd0-48a1-8bc8-f6dc1773f02e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:33.859744 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-405c87ef-cfd0-48a1-8bc8-f6dc1773f02e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:33.859744 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-405c87ef-cfd0-48a1-8bc8-f6dc1773f02e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:34.028465 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-405c87ef-cfd0-48a1-8bc8-f6dc1773f02e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:05:34.031711 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-405c87ef-cfd0-48a1-8bc8-f6dc1773f02e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a" status: 200 len: 1510 microversion: 2.1 time: 0.185991 Aug 03 19:05:34.032537 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 126/258] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:33 2022] GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a => generated 1510 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:05:35.060441 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-02e107e1-4f07-44c0-ab5b-749bc9a9e7f6 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:35.061033 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-02e107e1-4f07-44c0-ab5b-749bc9a9e7f6 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:35.067443 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-02e107e1-4f07-44c0-ab5b-749bc9a9e7f6 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:35.067900 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-02e107e1-4f07-44c0-ab5b-749bc9a9e7f6 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:35.068759 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-02e107e1-4f07-44c0-ab5b-749bc9a9e7f6 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:35.069209 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-02e107e1-4f07-44c0-ab5b-749bc9a9e7f6 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:35.215777 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-02e107e1-4f07-44c0-ab5b-749bc9a9e7f6 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:05:35.226031 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-02e107e1-4f07-44c0-ab5b-749bc9a9e7f6 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a" status: 200 len: 1510 microversion: 2.1 time: 0.169433 Aug 03 19:05:35.230036 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 133/259] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:35 2022] GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a => generated 1510 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:05:36.248663 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-05ddf483-c1f6-40ce-b838-2689415013a5 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:36.249279 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-05ddf483-c1f6-40ce-b838-2689415013a5 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:36.256849 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-05ddf483-c1f6-40ce-b838-2689415013a5 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:36.257298 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-05ddf483-c1f6-40ce-b838-2689415013a5 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:36.258109 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-05ddf483-c1f6-40ce-b838-2689415013a5 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:36.258571 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-05ddf483-c1f6-40ce-b838-2689415013a5 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:36.418494 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-05ddf483-c1f6-40ce-b838-2689415013a5 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:05:36.428725 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-05ddf483-c1f6-40ce-b838-2689415013a5 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a" status: 200 len: 1510 microversion: 2.1 time: 0.184587 Aug 03 19:05:36.429455 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 127/260] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:36 2022] GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a => generated 1510 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:05:37.450501 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-59bc3972-d467-4c42-99ea-eb62f6a030ad tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:37.451258 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-59bc3972-d467-4c42-99ea-eb62f6a030ad tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:37.457638 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-59bc3972-d467-4c42-99ea-eb62f6a030ad tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:37.458170 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-59bc3972-d467-4c42-99ea-eb62f6a030ad tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:37.458904 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-59bc3972-d467-4c42-99ea-eb62f6a030ad tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:37.459366 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-59bc3972-d467-4c42-99ea-eb62f6a030ad tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:37.624506 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-59bc3972-d467-4c42-99ea-eb62f6a030ad tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:05:37.646164 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-59bc3972-d467-4c42-99ea-eb62f6a030ad tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a" status: 200 len: 1510 microversion: 2.1 time: 0.200118 Aug 03 19:05:37.646801 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 134/261] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:37 2022] GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a => generated 1510 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:05:38.679339 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-ee8aaeff-b47f-4486-91f2-363ccec6eff3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:38.680621 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-ee8aaeff-b47f-4486-91f2-363ccec6eff3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:38.693227 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ee8aaeff-b47f-4486-91f2-363ccec6eff3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:38.693971 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ee8aaeff-b47f-4486-91f2-363ccec6eff3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:38.695274 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ee8aaeff-b47f-4486-91f2-363ccec6eff3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:38.695820 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ee8aaeff-b47f-4486-91f2-363ccec6eff3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:38.852793 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-ee8aaeff-b47f-4486-91f2-363ccec6eff3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:05:38.860524 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-ee8aaeff-b47f-4486-91f2-363ccec6eff3 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a" status: 200 len: 1510 microversion: 2.1 time: 0.190633 Aug 03 19:05:38.861101 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 128/262] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:38 2022] GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a => generated 1510 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:05:39.886393 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-6060cfe3-ed10-4e67-b9ea-d3c87e2c3e98 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:39.888477 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-6060cfe3-ed10-4e67-b9ea-d3c87e2c3e98 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:39.897071 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6060cfe3-ed10-4e67-b9ea-d3c87e2c3e98 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:39.911746 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6060cfe3-ed10-4e67-b9ea-d3c87e2c3e98 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:39.911746 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6060cfe3-ed10-4e67-b9ea-d3c87e2c3e98 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:39.911746 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6060cfe3-ed10-4e67-b9ea-d3c87e2c3e98 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:40.045641 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-6060cfe3-ed10-4e67-b9ea-d3c87e2c3e98 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:05:40.052846 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-6060cfe3-ed10-4e67-b9ea-d3c87e2c3e98 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a" status: 200 len: 1516 microversion: 2.1 time: 0.173783 Aug 03 19:05:40.053489 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 135/263] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:39 2022] GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a => generated 1516 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:06:03.155201 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-6ccf3fbe-685b-416d-be7a-df35b9231ecf tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Action: 'create', calling method: .version_select at 0x7f4786d435e0>, body: {"keypair": {"name": "tempest-keypair-1770038115", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9yvfL63IyzDnGcnDcSo8Qma5KKKMd7IGh78PGACM2FbBE+2yiUaOAp3Q1n1ixxK/UTwjwRs2+LWVlEwZ34bb7Te76dut789qkYNphc8XBPJvt5vURRS+E8+0GAMXClbA=="}} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:06:03.161782 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_api:SELECT=27 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:06:03.162652 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=41 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:06:03.180269 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.quota [None req-6ccf3fbe-685b-416d-be7a-df35b9231ecf tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Getting quotas for project bf009469f935465baa6427ab4951944e. Resources: {'key_pairs'} {{(pid=118302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:06:03.185445 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.quota [None req-6ccf3fbe-685b-416d-be7a-df35b9231ecf tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Getting quotas for user 9c46900844e8483bb2dff3b9e65df372 and project bf009469f935465baa6427ab4951944e. Resources: {'key_pairs'} {{(pid=118302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:06:03.339050 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-6ccf3fbe-685b-416d-be7a-df35b9231ecf tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.188582 Aug 03 19:06:03.346900 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 129/264] 10.222.0.77 () {60 vars in 1159 bytes} [Wed Aug 3 19:06:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:06:06.636871 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-19f4d466-113f-4475-a36d-4e95f0b46176 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-951432261", "imageRef": "0b6be242-215e-4886-a0d2-b8d5f8ca623e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3232e63b-0955-4dda-9cee-e40cb1ce02fa"}], "security_groups": [{"name": "tempest-securitygroup--594408036"}], "key_name": "tempest-keypair-1770038115", "user_data": "}} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:06:06.645429 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_api:SELECT=29 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:06:06.646226 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:06:06.765028 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.network.neutron [None req-19f4d466-113f-4475-a36d-4e95f0b46176 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] validate_networks() for [('3232e63b-0955-4dda-9cee-e40cb1ce02fa', None, None, None, None, None)] {{(pid=118303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 19:06:07.183825 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-19f4d466-113f-4475-a36d-4e95f0b46176 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Flavor limits 0:0:0 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 19:06:07.184247 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-19f4d466-113f-4475-a36d-4e95f0b46176 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Image limits 0:0:0 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 19:06:07.184721 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-19f4d466-113f-4475-a36d-4e95f0b46176 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Flavor pref 0:0:0 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 19:06:07.185132 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-19f4d466-113f-4475-a36d-4e95f0b46176 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Image pref 0:0:0 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 19:06:07.185548 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-19f4d466-113f-4475-a36d-4e95f0b46176 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 19:06:07.195111 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-19f4d466-113f-4475-a36d-4e95f0b46176 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:07.195556 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-19f4d466-113f-4475-a36d-4e95f0b46176 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:07.196380 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-19f4d466-113f-4475-a36d-4e95f0b46176 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:07.196813 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-19f4d466-113f-4475-a36d-4e95f0b46176 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:07.215025 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.quota [None req-19f4d466-113f-4475-a36d-4e95f0b46176 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Getting quotas for project bf009469f935465baa6427ab4951944e. Resources: {'instances', 'cores', 'ram'} {{(pid=118303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:06:07.218968 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.quota [None req-19f4d466-113f-4475-a36d-4e95f0b46176 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Getting quotas for user 9c46900844e8483bb2dff3b9e65df372 and project bf009469f935465baa6427ab4951944e. Resources: {'instances', 'cores', 'ram'} {{(pid=118303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:06:07.230110 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-19f4d466-113f-4475-a36d-4e95f0b46176 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Going to run 1 instances... {{(pid=118303) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 19:06:07.232427 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-19f4d466-113f-4475-a36d-4e95f0b46176 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0b6be242-215e-4886-a0d2-b8d5f8ca623e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 19:06:07.539266 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-19f4d466-113f-4475-a36d-4e95f0b46176 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.906824 Aug 03 19:06:07.540033 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 136/265] 10.222.0.77 () {60 vars in 1147 bytes} [Wed Aug 3 19:06:06 2022] POST /compute/v2.1/servers => generated 408 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 19:06:07.558784 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-402ceabd-bf9c-4326-8e77-b443152bc101 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:06:07.561592 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-402ceabd-bf9c-4326-8e77-b443152bc101 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:06:07.649952 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-402ceabd-bf9c-4326-8e77-b443152bc101 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:06:07.662497 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-402ceabd-bf9c-4326-8e77-b443152bc101 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1245 microversion: 2.1 time: 0.108427 Aug 03 19:06:07.663409 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 130/266] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:06:07 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1245 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:06:08.690900 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-cb439d18-0f24-42cd-a872-d577337d90df tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:06:08.691461 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-cb439d18-0f24-42cd-a872-d577337d90df tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:06:08.752197 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-cb439d18-0f24-42cd-a872-d577337d90df tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:06:08.767670 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-cb439d18-0f24-42cd-a872-d577337d90df tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1245 microversion: 2.1 time: 0.072064 Aug 03 19:06:08.767670 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 137/267] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:06:08 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1245 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:06:09.781232 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-a3842b0d-a6b5-4bff-993b-e1c742390710 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:06:09.781774 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-a3842b0d-a6b5-4bff-993b-e1c742390710 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:06:09.789309 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a3842b0d-a6b5-4bff-993b-e1c742390710 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:09.789795 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a3842b0d-a6b5-4bff-993b-e1c742390710 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:09.790587 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a3842b0d-a6b5-4bff-993b-e1c742390710 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:09.791255 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a3842b0d-a6b5-4bff-993b-e1c742390710 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:09.863916 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-a3842b0d-a6b5-4bff-993b-e1c742390710 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:06:09.872387 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-a3842b0d-a6b5-4bff-993b-e1c742390710 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1241 microversion: 2.1 time: 0.095267 Aug 03 19:06:09.881010 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 131/268] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:06:09 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1241 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:06:10.895229 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-b6fb5cd7-e2f7-4943-a51a-8640bbab2875 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:06:10.895940 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-b6fb5cd7-e2f7-4943-a51a-8640bbab2875 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:06:10.903047 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b6fb5cd7-e2f7-4943-a51a-8640bbab2875 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:10.903505 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b6fb5cd7-e2f7-4943-a51a-8640bbab2875 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:10.904274 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b6fb5cd7-e2f7-4943-a51a-8640bbab2875 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:10.904800 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b6fb5cd7-e2f7-4943-a51a-8640bbab2875 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:10.972688 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-b6fb5cd7-e2f7-4943-a51a-8640bbab2875 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:06:10.985330 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-b6fb5cd7-e2f7-4943-a51a-8640bbab2875 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1297 microversion: 2.1 time: 0.093904 Aug 03 19:06:10.986161 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 138/269] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:06:10 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1297 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:06:12.013526 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-4466ca21-cfb5-4299-b881-8afbad3882c6 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:06:12.014449 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-4466ca21-cfb5-4299-b881-8afbad3882c6 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:06:12.024183 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4466ca21-cfb5-4299-b881-8afbad3882c6 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:12.024926 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4466ca21-cfb5-4299-b881-8afbad3882c6 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:12.027180 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4466ca21-cfb5-4299-b881-8afbad3882c6 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:12.027912 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4466ca21-cfb5-4299-b881-8afbad3882c6 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:12.100568 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-4466ca21-cfb5-4299-b881-8afbad3882c6 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:06:12.109313 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-4466ca21-cfb5-4299-b881-8afbad3882c6 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1297 microversion: 2.1 time: 0.102861 Aug 03 19:06:12.109977 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 132/270] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:06:12 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1297 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:06:13.131136 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-82b9d950-7b12-41e9-acc4-ab248ce99133 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:06:13.131745 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-82b9d950-7b12-41e9-acc4-ab248ce99133 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:06:13.139041 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-82b9d950-7b12-41e9-acc4-ab248ce99133 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:13.139493 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-82b9d950-7b12-41e9-acc4-ab248ce99133 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:13.140301 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-82b9d950-7b12-41e9-acc4-ab248ce99133 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:13.140791 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-82b9d950-7b12-41e9-acc4-ab248ce99133 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:13.206431 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-82b9d950-7b12-41e9-acc4-ab248ce99133 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:06:13.217161 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-82b9d950-7b12-41e9-acc4-ab248ce99133 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1297 microversion: 2.1 time: 0.089933 Aug 03 19:06:13.217749 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 139/271] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:06:13 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1297 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:06:14.238544 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-0b2ce971-d551-42f0-b219-39d7c61aad8e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:06:14.239600 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-0b2ce971-d551-42f0-b219-39d7c61aad8e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:06:14.246912 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0b2ce971-d551-42f0-b219-39d7c61aad8e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:14.247396 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0b2ce971-d551-42f0-b219-39d7c61aad8e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:14.248206 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0b2ce971-d551-42f0-b219-39d7c61aad8e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:14.248645 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0b2ce971-d551-42f0-b219-39d7c61aad8e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:14.341218 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-0b2ce971-d551-42f0-b219-39d7c61aad8e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:06:14.352179 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-0b2ce971-d551-42f0-b219-39d7c61aad8e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1297 microversion: 2.1 time: 0.117736 Aug 03 19:06:14.353037 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 133/272] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:06:14 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1297 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:06:15.390484 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-e37ecf13-aeea-420c-a7bd-88f07d9dd997 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:06:15.390484 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-e37ecf13-aeea-420c-a7bd-88f07d9dd997 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:06:15.402088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e37ecf13-aeea-420c-a7bd-88f07d9dd997 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:15.402088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e37ecf13-aeea-420c-a7bd-88f07d9dd997 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:15.403333 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e37ecf13-aeea-420c-a7bd-88f07d9dd997 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:15.404148 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e37ecf13-aeea-420c-a7bd-88f07d9dd997 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:15.508144 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-e37ecf13-aeea-420c-a7bd-88f07d9dd997 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:06:15.517432 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-e37ecf13-aeea-420c-a7bd-88f07d9dd997 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1315 microversion: 2.1 time: 0.134001 Aug 03 19:06:15.518332 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 140/273] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:06:15 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1315 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:06:16.546885 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-0aee73fa-cfef-4cca-a5cc-21fdb3b05df5 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:06:16.547526 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-0aee73fa-cfef-4cca-a5cc-21fdb3b05df5 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:06:16.559186 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0aee73fa-cfef-4cca-a5cc-21fdb3b05df5 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:16.560224 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0aee73fa-cfef-4cca-a5cc-21fdb3b05df5 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:16.561746 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0aee73fa-cfef-4cca-a5cc-21fdb3b05df5 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:16.562645 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0aee73fa-cfef-4cca-a5cc-21fdb3b05df5 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:16.659645 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-0aee73fa-cfef-4cca-a5cc-21fdb3b05df5 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:06:16.673068 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-0aee73fa-cfef-4cca-a5cc-21fdb3b05df5 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1303 microversion: 2.1 time: 0.131845 Aug 03 19:06:16.674113 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 134/274] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:06:16 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1303 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:06:17.714406 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-96b5e35f-43fc-40ce-9000-88452e6e4cc0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:06:17.716010 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-96b5e35f-43fc-40ce-9000-88452e6e4cc0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:06:17.726047 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell0:SELECT=2 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:06:17.729980 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-96b5e35f-43fc-40ce-9000-88452e6e4cc0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:17.731306 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-96b5e35f-43fc-40ce-9000-88452e6e4cc0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:17.732979 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-96b5e35f-43fc-40ce-9000-88452e6e4cc0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:17.734126 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-96b5e35f-43fc-40ce-9000-88452e6e4cc0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:17.834014 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-96b5e35f-43fc-40ce-9000-88452e6e4cc0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:06:17.845727 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-96b5e35f-43fc-40ce-9000-88452e6e4cc0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1303 microversion: 2.1 time: 0.140404 Aug 03 19:06:17.846558 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 141/275] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:06:17 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1303 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:06:18.884846 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-a9865b6c-ac36-421c-86f0-32defcf3a621 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:06:18.885722 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-a9865b6c-ac36-421c-86f0-32defcf3a621 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:06:18.889072 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell0:SELECT=6 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:06:18.900819 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a9865b6c-ac36-421c-86f0-32defcf3a621 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:18.901284 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a9865b6c-ac36-421c-86f0-32defcf3a621 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:18.902082 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a9865b6c-ac36-421c-86f0-32defcf3a621 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:18.902531 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a9865b6c-ac36-421c-86f0-32defcf3a621 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:19.079874 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-a9865b6c-ac36-421c-86f0-32defcf3a621 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:06:19.089572 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-a9865b6c-ac36-421c-86f0-32defcf3a621 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1370 microversion: 2.1 time: 0.208702 Aug 03 19:06:19.090165 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 135/276] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:06:18 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1370 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:06:19.891448 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [req-e203b8d3-92a6-4371-8966-f38f721c4113 req-12f84e39-1393-4370-a304-1d1e5c6c7cdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87735baf-d677-4920-8453-c829a9e833b9", "tag": "013884d5-b737-4e4b-8a8f-00c6a8b5fbe3"}]} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:06:19.916090 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell0:SELECT=8 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:06:19.931053 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-e203b8d3-92a6-4371-8966-f38f721c4113 req-12f84e39-1393-4370-a304-1d1e5c6c7cdb service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:19.940939 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-e203b8d3-92a6-4371-8966-f38f721c4113 req-12f84e39-1393-4370-a304-1d1e5c6c7cdb service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:19.964930 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.compute.server_external_events [req-e203b8d3-92a6-4371-8966-f38f721c4113 req-12f84e39-1393-4370-a304-1d1e5c6c7cdb service nova] Creating event network-changed:013884d5-b737-4e4b-8a8f-00c6a8b5fbe3 for instance 87735baf-d677-4920-8453-c829a9e833b9 on hv-cinder-85202 Aug 03 19:06:19.972234 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [req-e203b8d3-92a6-4371-8966-f38f721c4113 req-12f84e39-1393-4370-a304-1d1e5c6c7cdb service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083695 Aug 03 19:06:19.973129 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 142/277] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:06:20.120654 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-7409c084-f20d-41f9-8009-25dac9c985e2 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:06:20.121700 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-7409c084-f20d-41f9-8009-25dac9c985e2 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:06:20.131180 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7409c084-f20d-41f9-8009-25dac9c985e2 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:20.131732 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7409c084-f20d-41f9-8009-25dac9c985e2 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:20.132625 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7409c084-f20d-41f9-8009-25dac9c985e2 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:20.133095 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7409c084-f20d-41f9-8009-25dac9c985e2 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:20.401960 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-7409c084-f20d-41f9-8009-25dac9c985e2 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:06:20.417310 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-7409c084-f20d-41f9-8009-25dac9c985e2 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1370 microversion: 2.1 time: 0.303380 Aug 03 19:06:20.417923 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 136/278] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:06:20 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1370 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:06:21.449528 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-d0762406-2df3-4a4c-b1c1-16d39b1f3fe1 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:06:21.453700 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-d0762406-2df3-4a4c-b1c1-16d39b1f3fe1 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:06:21.470540 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d0762406-2df3-4a4c-b1c1-16d39b1f3fe1 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:21.471114 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d0762406-2df3-4a4c-b1c1-16d39b1f3fe1 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:21.474976 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d0762406-2df3-4a4c-b1c1-16d39b1f3fe1 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:21.475610 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d0762406-2df3-4a4c-b1c1-16d39b1f3fe1 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:21.726546 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-d0762406-2df3-4a4c-b1c1-16d39b1f3fe1 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:06:21.747198 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-d0762406-2df3-4a4c-b1c1-16d39b1f3fe1 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1370 microversion: 2.1 time: 0.305445 Aug 03 19:06:21.748086 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 143/279] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:06:21 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1370 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:06:22.773358 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-4c11e4c0-798e-46c8-bf2a-f2c4df63f809 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:06:22.776629 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-4c11e4c0-798e-46c8-bf2a-f2c4df63f809 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:06:22.784231 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4c11e4c0-798e-46c8-bf2a-f2c4df63f809 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:22.784681 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4c11e4c0-798e-46c8-bf2a-f2c4df63f809 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:22.785470 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4c11e4c0-798e-46c8-bf2a-f2c4df63f809 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:22.785913 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4c11e4c0-798e-46c8-bf2a-f2c4df63f809 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:23.051893 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-4c11e4c0-798e-46c8-bf2a-f2c4df63f809 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:06:23.065362 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-4c11e4c0-798e-46c8-bf2a-f2c4df63f809 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1370 microversion: 2.1 time: 0.298023 Aug 03 19:06:23.066366 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 137/280] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:06:22 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1370 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:06:24.101294 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-1e2ec44b-5c4b-427b-b006-a46f89a95072 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:06:24.102301 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-1e2ec44b-5c4b-427b-b006-a46f89a95072 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:06:24.113347 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1e2ec44b-5c4b-427b-b006-a46f89a95072 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:24.114577 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1e2ec44b-5c4b-427b-b006-a46f89a95072 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:24.116095 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1e2ec44b-5c4b-427b-b006-a46f89a95072 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:24.116819 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1e2ec44b-5c4b-427b-b006-a46f89a95072 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:24.311826 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-1e2ec44b-5c4b-427b-b006-a46f89a95072 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:06:24.320336 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-1e2ec44b-5c4b-427b-b006-a46f89a95072 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1370 microversion: 2.1 time: 0.225000 Aug 03 19:06:24.321156 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 144/281] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:06:24 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1370 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:06:25.343070 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-61be5e14-b634-4745-8fec-f9eadcab16a9 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:06:25.344259 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-61be5e14-b634-4745-8fec-f9eadcab16a9 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:06:25.353470 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-61be5e14-b634-4745-8fec-f9eadcab16a9 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:25.353470 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-61be5e14-b634-4745-8fec-f9eadcab16a9 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:25.354421 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-61be5e14-b634-4745-8fec-f9eadcab16a9 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:25.354871 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-61be5e14-b634-4745-8fec-f9eadcab16a9 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:25.634858 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-61be5e14-b634-4745-8fec-f9eadcab16a9 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:06:25.653501 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-61be5e14-b634-4745-8fec-f9eadcab16a9 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1370 microversion: 2.1 time: 0.314596 Aug 03 19:06:25.656736 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 138/282] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:06:25 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1370 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:06:26.496216 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 19:06:26.497147 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Wed Aug 3 19:06:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 19:06:26.685323 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-004a3241-1f53-4a97-9ac1-6dc7365abb4e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:06:26.686703 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-004a3241-1f53-4a97-9ac1-6dc7365abb4e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:06:26.696337 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-004a3241-1f53-4a97-9ac1-6dc7365abb4e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:26.696925 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-004a3241-1f53-4a97-9ac1-6dc7365abb4e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:26.698177 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-004a3241-1f53-4a97-9ac1-6dc7365abb4e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:26.698711 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-004a3241-1f53-4a97-9ac1-6dc7365abb4e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:26.947876 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-004a3241-1f53-4a97-9ac1-6dc7365abb4e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:06:26.967469 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-004a3241-1f53-4a97-9ac1-6dc7365abb4e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1370 microversion: 2.1 time: 0.288574 Aug 03 19:06:26.982455 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 145/283] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:06:26 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1370 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:06:28.008717 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-026e8d88-40e6-4636-9c88-689ea7844cd6 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:06:28.015282 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-026e8d88-40e6-4636-9c88-689ea7844cd6 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:06:28.027051 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-026e8d88-40e6-4636-9c88-689ea7844cd6 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:28.027935 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-026e8d88-40e6-4636-9c88-689ea7844cd6 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:28.030100 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-026e8d88-40e6-4636-9c88-689ea7844cd6 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:28.031056 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-026e8d88-40e6-4636-9c88-689ea7844cd6 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:28.167655 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 19:06:28.167655 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Wed Aug 3 19:06:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 (ip 10.222.0.77) !!! Aug 03 19:06:28.342461 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-026e8d88-40e6-4636-9c88-689ea7844cd6 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:06:28.353921 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-026e8d88-40e6-4636-9c88-689ea7844cd6 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1370 microversion: 2.1 time: 0.364464 Aug 03 19:06:28.354933 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 139/284] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:06:27 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1370 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:06:29.393476 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-fe11f398-a0ba-4f07-ad24-c0fa0c7a6e15 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:06:29.395596 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-fe11f398-a0ba-4f07-ad24-c0fa0c7a6e15 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:06:29.414233 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fe11f398-a0ba-4f07-ad24-c0fa0c7a6e15 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:29.414886 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fe11f398-a0ba-4f07-ad24-c0fa0c7a6e15 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:29.417398 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fe11f398-a0ba-4f07-ad24-c0fa0c7a6e15 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:29.418251 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fe11f398-a0ba-4f07-ad24-c0fa0c7a6e15 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:29.576195 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-802e78ed-a160-4891-b9cc-681b91335bf3 req-c184b438-e797-4fe1-807d-84c25c89002d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87735baf-d677-4920-8453-c829a9e833b9", "name": "network-vif-plugged", "status": "completed", "tag": "013884d5-b737-4e4b-8a8f-00c6a8b5fbe3"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:06:29.612018 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-802e78ed-a160-4891-b9cc-681b91335bf3 req-c184b438-e797-4fe1-807d-84c25c89002d service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:29.612993 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-802e78ed-a160-4891-b9cc-681b91335bf3 req-c184b438-e797-4fe1-807d-84c25c89002d service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:29.635497 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-802e78ed-a160-4891-b9cc-681b91335bf3 req-c184b438-e797-4fe1-807d-84c25c89002d service nova] Creating event network-vif-plugged:013884d5-b737-4e4b-8a8f-00c6a8b5fbe3 for instance 87735baf-d677-4920-8453-c829a9e833b9 on hv-cinder-85202 Aug 03 19:06:29.641136 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-802e78ed-a160-4891-b9cc-681b91335bf3 req-c184b438-e797-4fe1-807d-84c25c89002d service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069900 Aug 03 19:06:29.642230 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 140/285] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 19:06:29.662583 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-fe11f398-a0ba-4f07-ad24-c0fa0c7a6e15 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:06:29.671930 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-fe11f398-a0ba-4f07-ad24-c0fa0c7a6e15 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1370 microversion: 2.1 time: 0.287713 Aug 03 19:06:29.672510 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 146/286] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:06:29 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1370 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:06:30.706010 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-2a4cd974-efbb-4900-98d6-9203b6ba2e12 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:06:30.708243 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-2a4cd974-efbb-4900-98d6-9203b6ba2e12 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:06:30.722049 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2a4cd974-efbb-4900-98d6-9203b6ba2e12 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:30.722877 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2a4cd974-efbb-4900-98d6-9203b6ba2e12 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:30.724367 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2a4cd974-efbb-4900-98d6-9203b6ba2e12 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:30.724938 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2a4cd974-efbb-4900-98d6-9203b6ba2e12 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:30.930801 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-2a4cd974-efbb-4900-98d6-9203b6ba2e12 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:06:30.940265 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-2a4cd974-efbb-4900-98d6-9203b6ba2e12 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1370 microversion: 2.1 time: 0.240000 Aug 03 19:06:30.941237 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 141/287] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:06:30 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1370 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:06:31.973201 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-48fc1d5f-e43e-4df7-b150-685e39007082 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:06:31.974419 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-48fc1d5f-e43e-4df7-b150-685e39007082 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:06:31.980551 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-48fc1d5f-e43e-4df7-b150-685e39007082 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:31.981009 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-48fc1d5f-e43e-4df7-b150-685e39007082 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:31.981785 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-48fc1d5f-e43e-4df7-b150-685e39007082 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:31.982219 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-48fc1d5f-e43e-4df7-b150-685e39007082 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:32.200313 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-48fc1d5f-e43e-4df7-b150-685e39007082 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:06:32.209158 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-48fc1d5f-e43e-4df7-b150-685e39007082 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1370 microversion: 2.1 time: 0.239959 Aug 03 19:06:32.210466 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 147/288] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:06:31 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1370 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:06:33.232981 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-146af9c1-7f32-44f9-90d8-c7bd327224a0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:06:33.234673 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-146af9c1-7f32-44f9-90d8-c7bd327224a0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:06:33.244971 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-146af9c1-7f32-44f9-90d8-c7bd327224a0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:33.245785 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-146af9c1-7f32-44f9-90d8-c7bd327224a0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:33.248046 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-146af9c1-7f32-44f9-90d8-c7bd327224a0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:33.248046 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-146af9c1-7f32-44f9-90d8-c7bd327224a0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:33.435615 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-146af9c1-7f32-44f9-90d8-c7bd327224a0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:06:33.454520 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-146af9c1-7f32-44f9-90d8-c7bd327224a0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1564 microversion: 2.1 time: 0.222573 Aug 03 19:06:33.454520 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 142/289] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:06:33 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1564 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:06:33.476339 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-5682bdef-7900-45bd-b411-aa5eb13a8968 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:06:33.477145 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-5682bdef-7900-45bd-b411-aa5eb13a8968 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:06:33.484921 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5682bdef-7900-45bd-b411-aa5eb13a8968 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:33.485391 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5682bdef-7900-45bd-b411-aa5eb13a8968 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:33.486173 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5682bdef-7900-45bd-b411-aa5eb13a8968 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:33.487031 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5682bdef-7900-45bd-b411-aa5eb13a8968 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:33.621918 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-5682bdef-7900-45bd-b411-aa5eb13a8968 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.151401 Aug 03 19:06:33.623545 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 148/290] 10.222.0.77 () {58 vars in 1275 bytes} [Wed Aug 3 19:06:33 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9/os-interface => generated 284 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 19:06:35.134915 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-a148324d-2bba-43ee-ad81-06d26c1bd2bc req-0ee16b66-f756-4ffa-a3c5-3b766030dcb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87735baf-d677-4920-8453-c829a9e833b9", "tag": "013884d5-b737-4e4b-8a8f-00c6a8b5fbe3"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:06:35.140399 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:06:35.150175 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-a148324d-2bba-43ee-ad81-06d26c1bd2bc req-0ee16b66-f756-4ffa-a3c5-3b766030dcb4 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:35.150631 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-a148324d-2bba-43ee-ad81-06d26c1bd2bc req-0ee16b66-f756-4ffa-a3c5-3b766030dcb4 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:35.163191 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-a148324d-2bba-43ee-ad81-06d26c1bd2bc req-0ee16b66-f756-4ffa-a3c5-3b766030dcb4 service nova] Creating event network-changed:013884d5-b737-4e4b-8a8f-00c6a8b5fbe3 for instance 87735baf-d677-4920-8453-c829a9e833b9 on hv-cinder-85202 Aug 03 19:06:35.170739 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-a148324d-2bba-43ee-ad81-06d26c1bd2bc req-0ee16b66-f756-4ffa-a3c5-3b766030dcb4 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039686 Aug 03 19:06:35.171981 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 143/291] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:07:01.413066 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:07:01.415447 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=62 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:07:01.421428 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-13ce53bc-1c16-46f9-9746-6c5a5f8d2535 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:01.422382 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-13ce53bc-1c16-46f9-9746-6c5a5f8d2535 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:01.432092 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-13ce53bc-1c16-46f9-9746-6c5a5f8d2535 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:01.433038 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-13ce53bc-1c16-46f9-9746-6c5a5f8d2535 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:01.433936 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-13ce53bc-1c16-46f9-9746-6c5a5f8d2535 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:01.434601 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-13ce53bc-1c16-46f9-9746-6c5a5f8d2535 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:01.465801 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-13ce53bc-1c16-46f9-9746-6c5a5f8d2535 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd/ips" status: 200 len: 145 microversion: 2.1 time: 0.054172 Aug 03 19:07:01.467041 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 149/292] 10.222.0.77 () {58 vars in 1248 bytes} [Wed Aug 3 19:07:01 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd/ips => generated 145 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:07:03.186972 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=70 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:07:03.497255 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-0513dd24-ee2f-4f74-8b0a-c023effdd332 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Action: 'create', calling method: .version_select at 0x7f4786bdaca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2102723523", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJj7ziy57EPQOh3oAg6+O7hjwHHvXAb/5VIdOrKPze3DNZ4hSBNEY6/lxRGPXsS60VhofT7P6rBu6bG2GU5Ug+uFkjSjid9jOPZX5xMg0ITNAnQpr+v6JH0nBALQdeR8gQ=="}} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:07:03.537054 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.quota [None req-0513dd24-ee2f-4f74-8b0a-c023effdd332 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Getting quotas for project 7d95b59405174f9689f50fe29d1b4061. Resources: {'key_pairs'} {{(pid=118302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:07:03.546607 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.quota [None req-0513dd24-ee2f-4f74-8b0a-c023effdd332 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Getting quotas for user 7697d104507d47d9be2ff025fb622235 and project 7d95b59405174f9689f50fe29d1b4061. Resources: {'key_pairs'} {{(pid=118302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:07:03.650322 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-0513dd24-ee2f-4f74-8b0a-c023effdd332 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.468959 Aug 03 19:07:03.651150 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 144/293] 10.222.0.77 () {60 vars in 1159 bytes} [Wed Aug 3 19:07:03 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:07:07.171506 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-6b2a6d73-1863-45b8-a5b9-6751aeeb9908 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf85f991-d269-453b-b500-d85a2ccec708"}} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:07:07.176980 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-6b2a6d73-1863-45b8-a5b9-6751aeeb9908 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:07.186149 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6b2a6d73-1863-45b8-a5b9-6751aeeb9908 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:07.186716 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6b2a6d73-1863-45b8-a5b9-6751aeeb9908 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:07.187680 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6b2a6d73-1863-45b8-a5b9-6751aeeb9908 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:07.188186 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6b2a6d73-1863-45b8-a5b9-6751aeeb9908 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:08.544277 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-6b2a6d73-1863-45b8-a5b9-6751aeeb9908 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "POST /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.381680 Aug 03 19:07:08.545269 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 150/294] 10.222.0.77 () {60 vars in 1323 bytes} [Wed Aug 3 19:07:07 2022] POST /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd/os-volume_attachments => generated 194 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:07:17.909684 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-7d8c0233-7bef-43cd-bc66-5eae9290fed0 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:07:17.926637 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell0:SELECT=4 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:07:17.938491 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7d8c0233-7bef-43cd-bc66-5eae9290fed0 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:17.940790 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7d8c0233-7bef-43cd-bc66-5eae9290fed0 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:18.049543 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-7d8c0233-7bef-43cd-bc66-5eae9290fed0 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Going to try to stop instance {{(pid=118302) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 03 19:07:18.401692 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-7d8c0233-7bef-43cd-bc66-5eae9290fed0 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "POST /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd/action" status: 202 len: 0 microversion: 2.1 time: 0.503052 Aug 03 19:07:18.402218 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 145/295] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 3 19:07:17 2022] POST /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd/action => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 19:07:18.409272 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_api:SELECT=4 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:07:18.410037 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:07:18.415316 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-8dfc1a78-3ae9-49a2-877a-7a9a32947e6f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:18.416477 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-8dfc1a78-3ae9-49a2-877a-7a9a32947e6f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:18.424926 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8dfc1a78-3ae9-49a2-877a-7a9a32947e6f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:18.425677 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8dfc1a78-3ae9-49a2-877a-7a9a32947e6f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:18.426630 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8dfc1a78-3ae9-49a2-877a-7a9a32947e6f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:18.427087 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8dfc1a78-3ae9-49a2-877a-7a9a32947e6f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:18.612620 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-8dfc1a78-3ae9-49a2-877a-7a9a32947e6f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:18.624272 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-8dfc1a78-3ae9-49a2-877a-7a9a32947e6f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1723 microversion: 2.1 time: 0.216866 Aug 03 19:07:18.627955 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 151/296] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:18 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:19.646903 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-7672249d-b354-4ce2-b15d-64ec4399bc4e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:19.648022 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-7672249d-b354-4ce2-b15d-64ec4399bc4e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:19.656944 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7672249d-b354-4ce2-b15d-64ec4399bc4e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:19.658436 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7672249d-b354-4ce2-b15d-64ec4399bc4e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:19.661200 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7672249d-b354-4ce2-b15d-64ec4399bc4e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:19.661905 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7672249d-b354-4ce2-b15d-64ec4399bc4e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:19.854911 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-7672249d-b354-4ce2-b15d-64ec4399bc4e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:19.874280 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-7672249d-b354-4ce2-b15d-64ec4399bc4e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1723 microversion: 2.1 time: 0.232062 Aug 03 19:07:19.888829 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 146/297] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:19 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:20.898299 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-982792ef-440e-44df-809e-8e62d42ef72f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:20.898916 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-982792ef-440e-44df-809e-8e62d42ef72f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:20.915814 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-982792ef-440e-44df-809e-8e62d42ef72f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:20.916519 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-982792ef-440e-44df-809e-8e62d42ef72f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:20.917628 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-982792ef-440e-44df-809e-8e62d42ef72f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:20.918066 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-982792ef-440e-44df-809e-8e62d42ef72f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:21.141504 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-982792ef-440e-44df-809e-8e62d42ef72f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:21.153045 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-982792ef-440e-44df-809e-8e62d42ef72f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1723 microversion: 2.1 time: 0.258741 Aug 03 19:07:21.154156 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 152/298] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:20 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:21.480665 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-680b9550-e9a1-45e8-8ab5-fdd83d6c97c5 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Action: 'create', calling method: .version_select at 0x7f4786cfc280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1132387639", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrjjAq+OMF2VjY85mFNOFbNqHOoqxgBdtOU/8XfR02mhHN6uhWtCvxIChGezgjwMtVWDipCcPbVdWBBH8KlZFSsQU2FWb+fGjXl83zg3y5UBOHkmUzrYm8qdFtLXceh6w=="}} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:07:21.497052 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.quota [None req-680b9550-e9a1-45e8-8ab5-fdd83d6c97c5 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Getting quotas for project 28d15350ea8f45b490bb080384999f4b. Resources: {'key_pairs'} {{(pid=118302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:07:21.501150 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.quota [None req-680b9550-e9a1-45e8-8ab5-fdd83d6c97c5 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Getting quotas for user 626fe64980ed40d4bbb829c75dc0067c and project 28d15350ea8f45b490bb080384999f4b. Resources: {'key_pairs'} {{(pid=118302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:07:21.615304 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-680b9550-e9a1-45e8-8ab5-fdd83d6c97c5 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.334996 Aug 03 19:07:21.615902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 147/299] 10.222.0.77 () {60 vars in 1159 bytes} [Wed Aug 3 19:07:21 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:07:22.174712 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-dc1e5e4e-5e1b-46a2-a33f-50d21e2dfb33 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:22.175433 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-dc1e5e4e-5e1b-46a2-a33f-50d21e2dfb33 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:22.183145 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-dc1e5e4e-5e1b-46a2-a33f-50d21e2dfb33 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:22.183595 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-dc1e5e4e-5e1b-46a2-a33f-50d21e2dfb33 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:22.184387 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-dc1e5e4e-5e1b-46a2-a33f-50d21e2dfb33 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:22.184818 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-dc1e5e4e-5e1b-46a2-a33f-50d21e2dfb33 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:22.339494 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-dc1e5e4e-5e1b-46a2-a33f-50d21e2dfb33 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:22.348293 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-dc1e5e4e-5e1b-46a2-a33f-50d21e2dfb33 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1723 microversion: 2.1 time: 0.177922 Aug 03 19:07:22.349136 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 153/300] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:22 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:22.512248 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-f47e8b36-6ef2-4a70-90c1-218c139f07a0 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2020142723", "imageRef": "0b6be242-215e-4886-a0d2-b8d5f8ca623e", "flavorRef": "452"}} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:07:22.566750 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.network.neutron [None req-f47e8b36-6ef2-4a70-90c1-218c139f07a0 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] validate_networks() for None {{(pid=118302) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 19:07:22.889914 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-f47e8b36-6ef2-4a70-90c1-218c139f07a0 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Flavor limits 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 19:07:22.890538 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-f47e8b36-6ef2-4a70-90c1-218c139f07a0 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Image limits 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 19:07:22.891041 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-f47e8b36-6ef2-4a70-90c1-218c139f07a0 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Flavor pref 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 19:07:22.891524 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-f47e8b36-6ef2-4a70-90c1-218c139f07a0 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Image pref 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 19:07:22.892292 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-f47e8b36-6ef2-4a70-90c1-218c139f07a0 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 19:07:22.908331 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f47e8b36-6ef2-4a70-90c1-218c139f07a0 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:22.909345 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f47e8b36-6ef2-4a70-90c1-218c139f07a0 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:22.910144 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f47e8b36-6ef2-4a70-90c1-218c139f07a0 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:22.910811 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f47e8b36-6ef2-4a70-90c1-218c139f07a0 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:22.930016 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.quota [None req-f47e8b36-6ef2-4a70-90c1-218c139f07a0 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Getting quotas for project 7689529c98354844a2c1a0bc0a02cce6. Resources: {'instances', 'cores', 'ram'} {{(pid=118302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:07:22.935629 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.quota [None req-f47e8b36-6ef2-4a70-90c1-218c139f07a0 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Getting quotas for user c2bfa14ebb124ea8863e8fc5d631c83a and project 7689529c98354844a2c1a0bc0a02cce6. Resources: {'instances', 'cores', 'ram'} {{(pid=118302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:07:22.948540 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-f47e8b36-6ef2-4a70-90c1-218c139f07a0 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Going to run 1 instances... {{(pid=118302) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 19:07:22.950799 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-f47e8b36-6ef2-4a70-90c1-218c139f07a0 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] [instance: 37a4328e-76ab-4488-9c9f-68e8d817dceb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0b6be242-215e-4886-a0d2-b8d5f8ca623e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 19:07:23.133139 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-f47e8b36-6ef2-4a70-90c1-218c139f07a0 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.626959 Aug 03 19:07:23.134994 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 148/301] 10.222.0.77 () {60 vars in 1147 bytes} [Wed Aug 3 19:07:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 19:07:23.149575 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-f3f1a1fb-e6d1-4a21-a632-e5e8748cd2ba tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:23.150853 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-f3f1a1fb-e6d1-4a21-a632-e5e8748cd2ba tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] [instance: 37a4328e-76ab-4488-9c9f-68e8d817dceb] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:23.218137 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-f3f1a1fb-e6d1-4a21-a632-e5e8748cd2ba tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bfa14ebb124ea8863e8fc5d631c83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7689529c98354844a2c1a0bc0a02cce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:23.228353 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-f3f1a1fb-e6d1-4a21-a632-e5e8748cd2ba tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] 10.222.0.77 "GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb" status: 200 len: 1215 microversion: 2.1 time: 0.085616 Aug 03 19:07:23.230499 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 154/302] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:23 2022] GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb => generated 1215 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:23.370724 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-8d76b321-6c58-4910-8a7b-56e8f5b7a9ac tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:23.371474 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-8d76b321-6c58-4910-8a7b-56e8f5b7a9ac tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:23.377903 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8d76b321-6c58-4910-8a7b-56e8f5b7a9ac tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:23.378360 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8d76b321-6c58-4910-8a7b-56e8f5b7a9ac tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:23.379170 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8d76b321-6c58-4910-8a7b-56e8f5b7a9ac tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:23.379631 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8d76b321-6c58-4910-8a7b-56e8f5b7a9ac tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:23.520585 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-8d76b321-6c58-4910-8a7b-56e8f5b7a9ac tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:23.529656 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-8d76b321-6c58-4910-8a7b-56e8f5b7a9ac tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1723 microversion: 2.1 time: 0.163288 Aug 03 19:07:23.530434 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 149/303] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:23 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:07:24.257748 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-9ac41eca-4a66-439b-a2c3-66dc7534d271 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:24.259585 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-9ac41eca-4a66-439b-a2c3-66dc7534d271 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] [instance: 37a4328e-76ab-4488-9c9f-68e8d817dceb] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:24.318375 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-9ac41eca-4a66-439b-a2c3-66dc7534d271 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bfa14ebb124ea8863e8fc5d631c83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7689529c98354844a2c1a0bc0a02cce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:24.327629 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-9ac41eca-4a66-439b-a2c3-66dc7534d271 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] 10.222.0.77 "GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb" status: 200 len: 1215 microversion: 2.1 time: 0.074710 Aug 03 19:07:24.328338 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 155/304] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:24 2022] GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb => generated 1215 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:24.557016 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-12180a65-deed-43d8-86bb-b8f60c97bd51 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:24.557790 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-12180a65-deed-43d8-86bb-b8f60c97bd51 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:24.564942 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-12180a65-deed-43d8-86bb-b8f60c97bd51 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:24.565474 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-12180a65-deed-43d8-86bb-b8f60c97bd51 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:24.566367 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-12180a65-deed-43d8-86bb-b8f60c97bd51 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:24.566868 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-12180a65-deed-43d8-86bb-b8f60c97bd51 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:24.725995 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-12180a65-deed-43d8-86bb-b8f60c97bd51 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:24.735140 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-12180a65-deed-43d8-86bb-b8f60c97bd51 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1723 microversion: 2.1 time: 0.183125 Aug 03 19:07:24.736551 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 150/305] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:24 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:25.350772 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-6cc8977f-c8ba-4908-98a4-f5bcf1caa06b tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:25.351958 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-6cc8977f-c8ba-4908-98a4-f5bcf1caa06b tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] [instance: 37a4328e-76ab-4488-9c9f-68e8d817dceb] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:25.359864 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6cc8977f-c8ba-4908-98a4-f5bcf1caa06b tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:25.360331 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6cc8977f-c8ba-4908-98a4-f5bcf1caa06b tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:25.361434 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6cc8977f-c8ba-4908-98a4-f5bcf1caa06b tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:25.361878 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6cc8977f-c8ba-4908-98a4-f5bcf1caa06b tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:25.447624 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-6cc8977f-c8ba-4908-98a4-f5bcf1caa06b tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bfa14ebb124ea8863e8fc5d631c83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7689529c98354844a2c1a0bc0a02cce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:25.455826 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-6cc8977f-c8ba-4908-98a4-f5bcf1caa06b tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] 10.222.0.77 "GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb" status: 200 len: 1219 microversion: 2.1 time: 0.109910 Aug 03 19:07:25.456586 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 156/306] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:25 2022] GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb => generated 1219 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:25.757837 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-ddb1e12e-e086-4091-b4dd-03b0f70288cf tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:25.760107 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-ddb1e12e-e086-4091-b4dd-03b0f70288cf tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:25.767724 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ddb1e12e-e086-4091-b4dd-03b0f70288cf tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:25.768453 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ddb1e12e-e086-4091-b4dd-03b0f70288cf tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:25.769746 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ddb1e12e-e086-4091-b4dd-03b0f70288cf tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:25.770339 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ddb1e12e-e086-4091-b4dd-03b0f70288cf tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:25.942127 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-ddb1e12e-e086-4091-b4dd-03b0f70288cf tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:25.951571 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-ddb1e12e-e086-4091-b4dd-03b0f70288cf tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1723 microversion: 2.1 time: 0.197819 Aug 03 19:07:25.952306 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 151/307] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:25 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:26.477438 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-d4c54273-c0a3-4cdb-9c47-dc328abe4928 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:26.478203 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-d4c54273-c0a3-4cdb-9c47-dc328abe4928 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] [instance: 37a4328e-76ab-4488-9c9f-68e8d817dceb] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:26.491880 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d4c54273-c0a3-4cdb-9c47-dc328abe4928 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:26.491880 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d4c54273-c0a3-4cdb-9c47-dc328abe4928 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:26.491880 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d4c54273-c0a3-4cdb-9c47-dc328abe4928 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:26.491880 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d4c54273-c0a3-4cdb-9c47-dc328abe4928 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:26.560382 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-d4c54273-c0a3-4cdb-9c47-dc328abe4928 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bfa14ebb124ea8863e8fc5d631c83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7689529c98354844a2c1a0bc0a02cce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:26.567999 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-d4c54273-c0a3-4cdb-9c47-dc328abe4928 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] 10.222.0.77 "GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb" status: 200 len: 1267 microversion: 2.1 time: 0.094779 Aug 03 19:07:26.568587 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 157/308] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:26 2022] GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb => generated 1267 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:26.974249 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-c8405b74-096e-42ae-b0d4-21361324ed4e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:26.974901 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-c8405b74-096e-42ae-b0d4-21361324ed4e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:26.983027 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c8405b74-096e-42ae-b0d4-21361324ed4e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:26.983478 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c8405b74-096e-42ae-b0d4-21361324ed4e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:26.984343 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c8405b74-096e-42ae-b0d4-21361324ed4e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:26.984785 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c8405b74-096e-42ae-b0d4-21361324ed4e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:27.138742 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-c8405b74-096e-42ae-b0d4-21361324ed4e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:27.147605 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-c8405b74-096e-42ae-b0d4-21361324ed4e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1723 microversion: 2.1 time: 0.177202 Aug 03 19:07:27.148471 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 152/309] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:26 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:27.590322 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-e2107982-0320-4335-9327-484820d20a87 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:27.590974 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-e2107982-0320-4335-9327-484820d20a87 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] [instance: 37a4328e-76ab-4488-9c9f-68e8d817dceb] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:27.604670 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e2107982-0320-4335-9327-484820d20a87 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:27.605634 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e2107982-0320-4335-9327-484820d20a87 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:27.607052 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e2107982-0320-4335-9327-484820d20a87 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:27.607914 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e2107982-0320-4335-9327-484820d20a87 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:27.692271 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-e2107982-0320-4335-9327-484820d20a87 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bfa14ebb124ea8863e8fc5d631c83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7689529c98354844a2c1a0bc0a02cce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:27.700856 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-e2107982-0320-4335-9327-484820d20a87 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] 10.222.0.77 "GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb" status: 200 len: 1273 microversion: 2.1 time: 0.114927 Aug 03 19:07:27.701430 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 158/310] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:27 2022] GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb => generated 1273 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:28.170732 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-1f182e72-bcc0-4388-a993-6879bdc71f5f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:28.171362 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-1f182e72-bcc0-4388-a993-6879bdc71f5f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:28.186004 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1f182e72-bcc0-4388-a993-6879bdc71f5f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:28.186004 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1f182e72-bcc0-4388-a993-6879bdc71f5f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:28.186004 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1f182e72-bcc0-4388-a993-6879bdc71f5f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:28.186004 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1f182e72-bcc0-4388-a993-6879bdc71f5f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:28.332874 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-1f182e72-bcc0-4388-a993-6879bdc71f5f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:28.341907 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-1f182e72-bcc0-4388-a993-6879bdc71f5f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1723 microversion: 2.1 time: 0.174971 Aug 03 19:07:28.342337 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 153/311] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:28 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:28.723616 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-af8a47cd-57a4-4096-a37d-8dd87880d7a8 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:28.724223 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-af8a47cd-57a4-4096-a37d-8dd87880d7a8 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] [instance: 37a4328e-76ab-4488-9c9f-68e8d817dceb] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:28.731425 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-af8a47cd-57a4-4096-a37d-8dd87880d7a8 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:28.731871 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-af8a47cd-57a4-4096-a37d-8dd87880d7a8 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:28.732636 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-af8a47cd-57a4-4096-a37d-8dd87880d7a8 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:28.733062 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-af8a47cd-57a4-4096-a37d-8dd87880d7a8 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:28.905905 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-af8a47cd-57a4-4096-a37d-8dd87880d7a8 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bfa14ebb124ea8863e8fc5d631c83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7689529c98354844a2c1a0bc0a02cce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:28.915385 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-af8a47cd-57a4-4096-a37d-8dd87880d7a8 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] 10.222.0.77 "GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb" status: 200 len: 1315 microversion: 2.1 time: 0.195377 Aug 03 19:07:28.919044 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 159/312] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:28 2022] GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:29.032618 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-33dbd41b-3051-481b-b1fe-2284d1c626f7 req-25a840ba-d7bf-4ec9-8d3d-ab18d01eedc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37a4328e-76ab-4488-9c9f-68e8d817dceb", "tag": "449a18ec-73f1-4e99-aae8-7d7daf036cd9"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:07:29.044401 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-33dbd41b-3051-481b-b1fe-2284d1c626f7 req-25a840ba-d7bf-4ec9-8d3d-ab18d01eedc9 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:29.044847 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-33dbd41b-3051-481b-b1fe-2284d1c626f7 req-25a840ba-d7bf-4ec9-8d3d-ab18d01eedc9 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:29.064715 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-33dbd41b-3051-481b-b1fe-2284d1c626f7 req-25a840ba-d7bf-4ec9-8d3d-ab18d01eedc9 service nova] Creating event network-changed:449a18ec-73f1-4e99-aae8-7d7daf036cd9 for instance 37a4328e-76ab-4488-9c9f-68e8d817dceb on hv-cinder-85202 Aug 03 19:07:29.070728 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-33dbd41b-3051-481b-b1fe-2284d1c626f7 req-25a840ba-d7bf-4ec9-8d3d-ab18d01eedc9 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041064 Aug 03 19:07:29.072359 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 154/313] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:07:29.368440 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-ab7eb1e9-dcc2-4b11-821d-1d814f22e1b9 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:29.369087 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-ab7eb1e9-dcc2-4b11-821d-1d814f22e1b9 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:29.375206 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ab7eb1e9-dcc2-4b11-821d-1d814f22e1b9 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:29.375657 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ab7eb1e9-dcc2-4b11-821d-1d814f22e1b9 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:29.376425 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ab7eb1e9-dcc2-4b11-821d-1d814f22e1b9 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:29.376868 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ab7eb1e9-dcc2-4b11-821d-1d814f22e1b9 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:29.517552 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-ab7eb1e9-dcc2-4b11-821d-1d814f22e1b9 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:29.530378 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-ab7eb1e9-dcc2-4b11-821d-1d814f22e1b9 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1723 microversion: 2.1 time: 0.165865 Aug 03 19:07:29.531807 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 160/314] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:29 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:29.939169 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-37e8449a-3310-488f-95cd-693ae51195f8 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:29.939765 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-37e8449a-3310-488f-95cd-693ae51195f8 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] [instance: 37a4328e-76ab-4488-9c9f-68e8d817dceb] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:29.948276 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-37e8449a-3310-488f-95cd-693ae51195f8 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:29.948793 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-37e8449a-3310-488f-95cd-693ae51195f8 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:29.949571 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-37e8449a-3310-488f-95cd-693ae51195f8 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:29.950013 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-37e8449a-3310-488f-95cd-693ae51195f8 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:30.104570 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-37e8449a-3310-488f-95cd-693ae51195f8 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bfa14ebb124ea8863e8fc5d631c83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7689529c98354844a2c1a0bc0a02cce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:30.112742 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-37e8449a-3310-488f-95cd-693ae51195f8 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] 10.222.0.77 "GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb" status: 200 len: 1315 microversion: 2.1 time: 0.178498 Aug 03 19:07:30.113349 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 155/315] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:29 2022] GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:07:30.553885 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-ffd6d870-fe71-4fcb-bb80-26856b4c612b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:30.554429 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-ffd6d870-fe71-4fcb-bb80-26856b4c612b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:30.562117 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ffd6d870-fe71-4fcb-bb80-26856b4c612b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:30.562567 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ffd6d870-fe71-4fcb-bb80-26856b4c612b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:30.563371 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ffd6d870-fe71-4fcb-bb80-26856b4c612b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:30.563804 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ffd6d870-fe71-4fcb-bb80-26856b4c612b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:30.703846 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-ffd6d870-fe71-4fcb-bb80-26856b4c612b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:30.711694 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-ffd6d870-fe71-4fcb-bb80-26856b4c612b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1723 microversion: 2.1 time: 0.161802 Aug 03 19:07:30.712627 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 161/316] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:30 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:31.197776 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-75031c89-01b4-4a7f-888b-9d24954e08c9 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:31.198435 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-75031c89-01b4-4a7f-888b-9d24954e08c9 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] [instance: 37a4328e-76ab-4488-9c9f-68e8d817dceb] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:31.205371 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-75031c89-01b4-4a7f-888b-9d24954e08c9 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:31.205820 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-75031c89-01b4-4a7f-888b-9d24954e08c9 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:31.206606 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-75031c89-01b4-4a7f-888b-9d24954e08c9 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:31.207078 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-75031c89-01b4-4a7f-888b-9d24954e08c9 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:31.356939 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-75031c89-01b4-4a7f-888b-9d24954e08c9 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bfa14ebb124ea8863e8fc5d631c83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7689529c98354844a2c1a0bc0a02cce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:31.365321 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-75031c89-01b4-4a7f-888b-9d24954e08c9 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] 10.222.0.77 "GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb" status: 200 len: 1315 microversion: 2.1 time: 0.173299 Aug 03 19:07:31.365879 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 156/317] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:31 2022] GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:31.739222 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-e4d22987-eb1b-47e0-b443-275bfc0a4073 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:31.744615 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-e4d22987-eb1b-47e0-b443-275bfc0a4073 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:31.746832 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e4d22987-eb1b-47e0-b443-275bfc0a4073 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:31.747587 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e4d22987-eb1b-47e0-b443-275bfc0a4073 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:31.748067 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e4d22987-eb1b-47e0-b443-275bfc0a4073 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:31.748722 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e4d22987-eb1b-47e0-b443-275bfc0a4073 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:31.890004 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-e4d22987-eb1b-47e0-b443-275bfc0a4073 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:31.898670 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-e4d22987-eb1b-47e0-b443-275bfc0a4073 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1723 microversion: 2.1 time: 0.163488 Aug 03 19:07:31.899829 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 162/318] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:31 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:32.391427 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-1446c394-49cc-4ed1-8319-913f5dbdb0c5 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:32.391427 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-1446c394-49cc-4ed1-8319-913f5dbdb0c5 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] [instance: 37a4328e-76ab-4488-9c9f-68e8d817dceb] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:32.394272 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1446c394-49cc-4ed1-8319-913f5dbdb0c5 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:32.394711 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1446c394-49cc-4ed1-8319-913f5dbdb0c5 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:32.395501 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1446c394-49cc-4ed1-8319-913f5dbdb0c5 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:32.395933 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1446c394-49cc-4ed1-8319-913f5dbdb0c5 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:32.539977 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-1446c394-49cc-4ed1-8319-913f5dbdb0c5 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bfa14ebb124ea8863e8fc5d631c83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7689529c98354844a2c1a0bc0a02cce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:32.548142 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-1446c394-49cc-4ed1-8319-913f5dbdb0c5 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] 10.222.0.77 "GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb" status: 200 len: 1315 microversion: 2.1 time: 0.165964 Aug 03 19:07:32.551592 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 157/319] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:32 2022] GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:32.922604 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-a66a0388-2b4f-41cc-add1-3e0fbec7c19c tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:32.923719 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-a66a0388-2b4f-41cc-add1-3e0fbec7c19c tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:33.151448 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a66a0388-2b4f-41cc-add1-3e0fbec7c19c tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:33.151848 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a66a0388-2b4f-41cc-add1-3e0fbec7c19c tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:33.152629 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a66a0388-2b4f-41cc-add1-3e0fbec7c19c tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:33.153065 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a66a0388-2b4f-41cc-add1-3e0fbec7c19c tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:33.297599 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-a66a0388-2b4f-41cc-add1-3e0fbec7c19c tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:33.307198 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-a66a0388-2b4f-41cc-add1-3e0fbec7c19c tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1723 microversion: 2.1 time: 0.388330 Aug 03 19:07:33.307773 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 163/320] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:32 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1723 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:33.570001 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-60e768aa-e94a-4989-a9e6-6f5758c5ef1d tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:33.570600 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-60e768aa-e94a-4989-a9e6-6f5758c5ef1d tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] [instance: 37a4328e-76ab-4488-9c9f-68e8d817dceb] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:33.573489 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell0:SELECT=2 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:07:33.574390 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell0:SELECT=10 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:07:33.582388 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-60e768aa-e94a-4989-a9e6-6f5758c5ef1d tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:33.588558 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-60e768aa-e94a-4989-a9e6-6f5758c5ef1d tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:33.588558 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-60e768aa-e94a-4989-a9e6-6f5758c5ef1d tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:33.588558 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-60e768aa-e94a-4989-a9e6-6f5758c5ef1d tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:33.721549 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-60e768aa-e94a-4989-a9e6-6f5758c5ef1d tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bfa14ebb124ea8863e8fc5d631c83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7689529c98354844a2c1a0bc0a02cce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:33.729841 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-60e768aa-e94a-4989-a9e6-6f5758c5ef1d tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] 10.222.0.77 "GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb" status: 200 len: 1315 microversion: 2.1 time: 0.163870 Aug 03 19:07:33.730432 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 158/321] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:33 2022] GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:34.332534 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-1159178c-3958-48d0-a2d7-66c81f4ef35e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:34.333235 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-1159178c-3958-48d0-a2d7-66c81f4ef35e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:34.336018 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell0:SELECT=4 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:07:34.341756 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1159178c-3958-48d0-a2d7-66c81f4ef35e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:34.343237 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1159178c-3958-48d0-a2d7-66c81f4ef35e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:34.343237 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1159178c-3958-48d0-a2d7-66c81f4ef35e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:34.345502 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1159178c-3958-48d0-a2d7-66c81f4ef35e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:34.503384 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-1159178c-3958-48d0-a2d7-66c81f4ef35e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:34.510973 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-1159178c-3958-48d0-a2d7-66c81f4ef35e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1723 microversion: 2.1 time: 0.185457 Aug 03 19:07:34.511577 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 164/322] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:34 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:34.751986 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-86a0aba2-2e1e-4ccd-b0a7-b15b7e9c5915 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:34.752588 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-86a0aba2-2e1e-4ccd-b0a7-b15b7e9c5915 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] [instance: 37a4328e-76ab-4488-9c9f-68e8d817dceb] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:34.760109 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-86a0aba2-2e1e-4ccd-b0a7-b15b7e9c5915 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:34.760556 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-86a0aba2-2e1e-4ccd-b0a7-b15b7e9c5915 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:34.761325 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-86a0aba2-2e1e-4ccd-b0a7-b15b7e9c5915 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:34.761760 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-86a0aba2-2e1e-4ccd-b0a7-b15b7e9c5915 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:34.911745 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-86a0aba2-2e1e-4ccd-b0a7-b15b7e9c5915 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bfa14ebb124ea8863e8fc5d631c83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7689529c98354844a2c1a0bc0a02cce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:34.919924 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-86a0aba2-2e1e-4ccd-b0a7-b15b7e9c5915 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] 10.222.0.77 "GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb" status: 200 len: 1315 microversion: 2.1 time: 0.171831 Aug 03 19:07:34.927786 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 159/323] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:34 2022] GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:34.944560 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-9a275b61-7cb6-4633-a65d-389ae701f8d0 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-440089500", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2102723523", "security_groups": [{"name": "tempest-secgroup-smoke-1317257410"}], "networks": [{"uuid": "f51a331b-9c50-4d58-b256-a1de30da7b12"}], "block_device_mapping_v2": [{"uuid": "94a418f5-c88e-49b1-ba27-1385d5571a85", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:07:35.078087 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.network.neutron [None req-9a275b61-7cb6-4633-a65d-389ae701f8d0 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] validate_networks() for [('f51a331b-9c50-4d58-b256-a1de30da7b12', None, None, None, None, None)] {{(pid=118303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 19:07:35.488716 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-9a275b61-7cb6-4633-a65d-389ae701f8d0 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Flavor limits 0:0:0 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 19:07:35.489397 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-9a275b61-7cb6-4633-a65d-389ae701f8d0 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Image limits 0:0:0 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 19:07:35.489778 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-9a275b61-7cb6-4633-a65d-389ae701f8d0 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Flavor pref 0:0:0 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 19:07:35.490320 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-9a275b61-7cb6-4633-a65d-389ae701f8d0 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Image pref 0:0:0 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 19:07:35.490784 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-9a275b61-7cb6-4633-a65d-389ae701f8d0 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 19:07:35.533495 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-d692c988-42e0-40ab-bb1b-67a550616527 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:35.534373 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-d692c988-42e0-40ab-bb1b-67a550616527 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:35.541555 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d692c988-42e0-40ab-bb1b-67a550616527 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:35.542008 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d692c988-42e0-40ab-bb1b-67a550616527 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:35.543231 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d692c988-42e0-40ab-bb1b-67a550616527 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:35.543827 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d692c988-42e0-40ab-bb1b-67a550616527 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:35.659363 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9a275b61-7cb6-4633-a65d-389ae701f8d0 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:35.660324 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9a275b61-7cb6-4633-a65d-389ae701f8d0 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:35.661685 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9a275b61-7cb6-4633-a65d-389ae701f8d0 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:35.662912 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9a275b61-7cb6-4633-a65d-389ae701f8d0 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:35.685392 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.quota [None req-9a275b61-7cb6-4633-a65d-389ae701f8d0 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Getting quotas for project 7d95b59405174f9689f50fe29d1b4061. Resources: {'instances', 'cores', 'ram'} {{(pid=118303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:07:35.694247 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.quota [None req-9a275b61-7cb6-4633-a65d-389ae701f8d0 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Getting quotas for user 7697d104507d47d9be2ff025fb622235 and project 7d95b59405174f9689f50fe29d1b4061. Resources: {'instances', 'cores', 'ram'} {{(pid=118303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:07:35.734735 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-d692c988-42e0-40ab-bb1b-67a550616527 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:35.744176 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-d692c988-42e0-40ab-bb1b-67a550616527 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1700 microversion: 2.1 time: 0.214884 Aug 03 19:07:35.751101 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 160/324] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:35 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1700 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:07:35.771884 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-f260ad15-5009-4a82-b18a-014d6862b0f2 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:07:35.780241 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-9a275b61-7cb6-4633-a65d-389ae701f8d0 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Going to run 1 instances... {{(pid=118303) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 19:07:35.780426 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f260ad15-5009-4a82-b18a-014d6862b0f2 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:35.780882 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f260ad15-5009-4a82-b18a-014d6862b0f2 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:35.784963 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-9a275b61-7cb6-4633-a65d-389ae701f8d0 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='94a418f5-c88e-49b1-ba27-1385d5571a85',volume_size=None,volume_type=None)] {{(pid=118303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 19:07:35.809041 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-f260ad15-5009-4a82-b18a-014d6862b0f2 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Going to try to start instance {{(pid=118302) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 03 19:07:35.955048 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:07:36.154650 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-f260ad15-5009-4a82-b18a-014d6862b0f2 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "POST /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd/action" status: 202 len: 0 microversion: 2.1 time: 0.388513 Aug 03 19:07:36.155296 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 161/325] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 3 19:07:35 2022] POST /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd/action => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 19:07:36.163902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-40e47d88-e0db-4f0f-a5a8-9c78db0d6c7c tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:36.164793 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-40e47d88-e0db-4f0f-a5a8-9c78db0d6c7c tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] [instance: 37a4328e-76ab-4488-9c9f-68e8d817dceb] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:36.172481 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-40e47d88-e0db-4f0f-a5a8-9c78db0d6c7c tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:36.172930 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-40e47d88-e0db-4f0f-a5a8-9c78db0d6c7c tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:36.173709 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-40e47d88-e0db-4f0f-a5a8-9c78db0d6c7c tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:36.174145 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-40e47d88-e0db-4f0f-a5a8-9c78db0d6c7c tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:36.319417 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-40e47d88-e0db-4f0f-a5a8-9c78db0d6c7c tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bfa14ebb124ea8863e8fc5d631c83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7689529c98354844a2c1a0bc0a02cce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:36.327927 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-40e47d88-e0db-4f0f-a5a8-9c78db0d6c7c tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] 10.222.0.77 "GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb" status: 200 len: 1315 microversion: 2.1 time: 0.168084 Aug 03 19:07:36.328654 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 162/326] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:36 2022] GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:36.333078 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-b2a2531d-82ea-4067-82aa-2a9c2671fbae tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:36.339246 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-b2a2531d-82ea-4067-82aa-2a9c2671fbae tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:36.341221 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b2a2531d-82ea-4067-82aa-2a9c2671fbae tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:36.341995 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b2a2531d-82ea-4067-82aa-2a9c2671fbae tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:36.342843 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b2a2531d-82ea-4067-82aa-2a9c2671fbae tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:36.343357 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b2a2531d-82ea-4067-82aa-2a9c2671fbae tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:36.512953 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-b2a2531d-82ea-4067-82aa-2a9c2671fbae tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:36.523575 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-b2a2531d-82ea-4067-82aa-2a9c2671fbae tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1709 microversion: 2.1 time: 0.193694 Aug 03 19:07:36.524570 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 163/327] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:36 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1709 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:36.544168 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-9a275b61-7cb6-4633-a65d-389ae701f8d0 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.603467 Aug 03 19:07:36.545698 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 165/328] 10.222.0.77 () {60 vars in 1147 bytes} [Wed Aug 3 19:07:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 1606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 19:07:36.557510 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-3a4dee43-e7fe-40de-8eff-630e4f434c4f tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:36.558132 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-3a4dee43-e7fe-40de-8eff-630e4f434c4f tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:36.634539 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-3a4dee43-e7fe-40de-8eff-630e4f434c4f tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:36.641450 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-3a4dee43-e7fe-40de-8eff-630e4f434c4f tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1088 microversion: 2.1 time: 0.088388 Aug 03 19:07:36.642102 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 164/329] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:36 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1088 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:37.350703 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-a8579cef-03ed-4062-91c6-343a6841ce24 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:37.351284 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-a8579cef-03ed-4062-91c6-343a6841ce24 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] [instance: 37a4328e-76ab-4488-9c9f-68e8d817dceb] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:37.359384 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a8579cef-03ed-4062-91c6-343a6841ce24 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:37.360008 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a8579cef-03ed-4062-91c6-343a6841ce24 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:37.360734 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a8579cef-03ed-4062-91c6-343a6841ce24 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:37.362093 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a8579cef-03ed-4062-91c6-343a6841ce24 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:37.526549 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-a8579cef-03ed-4062-91c6-343a6841ce24 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bfa14ebb124ea8863e8fc5d631c83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7689529c98354844a2c1a0bc0a02cce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:37.539448 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-a8579cef-03ed-4062-91c6-343a6841ce24 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] 10.222.0.77 "GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb" status: 200 len: 1315 microversion: 2.1 time: 0.192528 Aug 03 19:07:37.541069 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 166/330] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:37 2022] GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:37.548448 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-987a62b1-c700-42d9-8224-74897fc2b4b1 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:37.549542 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-987a62b1-c700-42d9-8224-74897fc2b4b1 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:37.560365 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-987a62b1-c700-42d9-8224-74897fc2b4b1 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:37.569106 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-987a62b1-c700-42d9-8224-74897fc2b4b1 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:37.569106 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-987a62b1-c700-42d9-8224-74897fc2b4b1 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:37.569106 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-987a62b1-c700-42d9-8224-74897fc2b4b1 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:37.663033 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-0a31d5f7-cc45-43cf-ab56-e97b5db0d1a7 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:37.663995 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-0a31d5f7-cc45-43cf-ab56-e97b5db0d1a7 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:37.772486 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-0a31d5f7-cc45-43cf-ab56-e97b5db0d1a7 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:37.777500 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-987a62b1-c700-42d9-8224-74897fc2b4b1 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:37.780724 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-0a31d5f7-cc45-43cf-ab56-e97b5db0d1a7 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1088 microversion: 2.1 time: 0.122537 Aug 03 19:07:37.781514 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 167/331] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:37 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1088 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:37.786368 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-987a62b1-c700-42d9-8224-74897fc2b4b1 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1709 microversion: 2.1 time: 0.242999 Aug 03 19:07:37.787154 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 165/332] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:37 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1709 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:38.021641 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [req-173842b5-2627-4d3c-92bb-e4aac5d2e72e req-8fcd9a55-4d7e-4d6a-95f4-d013c15afd14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a4328e-76ab-4488-9c9f-68e8d817dceb", "name": "network-vif-plugged", "status": "completed", "tag": "449a18ec-73f1-4e99-aae8-7d7daf036cd9"}]} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:07:38.031352 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-173842b5-2627-4d3c-92bb-e4aac5d2e72e req-8fcd9a55-4d7e-4d6a-95f4-d013c15afd14 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:38.031790 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-173842b5-2627-4d3c-92bb-e4aac5d2e72e req-8fcd9a55-4d7e-4d6a-95f4-d013c15afd14 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:38.043949 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.compute.server_external_events [req-173842b5-2627-4d3c-92bb-e4aac5d2e72e req-8fcd9a55-4d7e-4d6a-95f4-d013c15afd14 service nova] Creating event network-vif-plugged:449a18ec-73f1-4e99-aae8-7d7daf036cd9 for instance 37a4328e-76ab-4488-9c9f-68e8d817dceb on hv-cinder-85202 Aug 03 19:07:38.049163 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [req-173842b5-2627-4d3c-92bb-e4aac5d2e72e req-8fcd9a55-4d7e-4d6a-95f4-d013c15afd14 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031182 Aug 03 19:07:38.049744 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 168/333] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:07:38.562053 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-ce7d4d6f-8fac-4d8d-b589-bcae9f7eb1e8 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:38.562685 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-ce7d4d6f-8fac-4d8d-b589-bcae9f7eb1e8 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] [instance: 37a4328e-76ab-4488-9c9f-68e8d817dceb] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:38.569400 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ce7d4d6f-8fac-4d8d-b589-bcae9f7eb1e8 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:38.569844 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ce7d4d6f-8fac-4d8d-b589-bcae9f7eb1e8 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:38.570599 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ce7d4d6f-8fac-4d8d-b589-bcae9f7eb1e8 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:38.571785 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ce7d4d6f-8fac-4d8d-b589-bcae9f7eb1e8 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:38.716361 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-ce7d4d6f-8fac-4d8d-b589-bcae9f7eb1e8 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bfa14ebb124ea8863e8fc5d631c83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7689529c98354844a2c1a0bc0a02cce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:38.724720 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-ce7d4d6f-8fac-4d8d-b589-bcae9f7eb1e8 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] 10.222.0.77 "GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb" status: 200 len: 1315 microversion: 2.1 time: 0.166550 Aug 03 19:07:38.725438 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 166/334] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:38 2022] GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:38.804030 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-c4b0d084-2ef0-4d86-9902-4d73d9089b37 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:38.804706 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-c4b0d084-2ef0-4d86-9902-4d73d9089b37 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:38.809248 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-e11f5d52-49a0-4bcf-8cf9-d768034efbc1 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:38.809871 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-e11f5d52-49a0-4bcf-8cf9-d768034efbc1 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:38.812009 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c4b0d084-2ef0-4d86-9902-4d73d9089b37 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:38.812508 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c4b0d084-2ef0-4d86-9902-4d73d9089b37 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:38.813417 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c4b0d084-2ef0-4d86-9902-4d73d9089b37 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:38.813844 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c4b0d084-2ef0-4d86-9902-4d73d9089b37 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:38.816362 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e11f5d52-49a0-4bcf-8cf9-d768034efbc1 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:38.816952 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e11f5d52-49a0-4bcf-8cf9-d768034efbc1 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:38.817735 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e11f5d52-49a0-4bcf-8cf9-d768034efbc1 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:38.818180 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e11f5d52-49a0-4bcf-8cf9-d768034efbc1 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:38.915007 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-c4b0d084-2ef0-4d86-9902-4d73d9089b37 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:38.924634 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-c4b0d084-2ef0-4d86-9902-4d73d9089b37 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1138 microversion: 2.1 time: 0.125454 Aug 03 19:07:38.925214 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 169/335] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:38 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1138 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:38.983034 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-e11f5d52-49a0-4bcf-8cf9-d768034efbc1 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:38.992293 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-e11f5d52-49a0-4bcf-8cf9-d768034efbc1 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1709 microversion: 2.1 time: 0.187458 Aug 03 19:07:38.992934 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 167/336] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:38 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1709 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:07:39.751264 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-a68c1bb2-edf7-415b-a260-27d7e2498706 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:39.751885 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-a68c1bb2-edf7-415b-a260-27d7e2498706 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] [instance: 37a4328e-76ab-4488-9c9f-68e8d817dceb] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:39.758146 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a68c1bb2-edf7-415b-a260-27d7e2498706 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:39.759427 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a68c1bb2-edf7-415b-a260-27d7e2498706 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:39.760134 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a68c1bb2-edf7-415b-a260-27d7e2498706 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:39.760570 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a68c1bb2-edf7-415b-a260-27d7e2498706 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:39.899908 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-a68c1bb2-edf7-415b-a260-27d7e2498706 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bfa14ebb124ea8863e8fc5d631c83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7689529c98354844a2c1a0bc0a02cce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:39.907642 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-a68c1bb2-edf7-415b-a260-27d7e2498706 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] 10.222.0.77 "GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb" status: 200 len: 1315 microversion: 2.1 time: 0.160581 Aug 03 19:07:39.908210 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 170/337] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:39 2022] GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:39.945985 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-71ba8754-62a2-4812-b888-b0c7b7d434d2 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:39.946595 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-71ba8754-62a2-4812-b888-b0c7b7d434d2 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:39.956288 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-71ba8754-62a2-4812-b888-b0c7b7d434d2 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:39.956288 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-71ba8754-62a2-4812-b888-b0c7b7d434d2 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:39.956288 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-71ba8754-62a2-4812-b888-b0c7b7d434d2 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:39.956288 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-71ba8754-62a2-4812-b888-b0c7b7d434d2 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:40.017768 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-ac968247-17bc-4877-bae1-310754b03ce2 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:40.018282 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-ac968247-17bc-4877-bae1-310754b03ce2 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:40.027296 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ac968247-17bc-4877-bae1-310754b03ce2 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:40.027792 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ac968247-17bc-4877-bae1-310754b03ce2 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:40.028598 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ac968247-17bc-4877-bae1-310754b03ce2 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:40.029046 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ac968247-17bc-4877-bae1-310754b03ce2 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:40.032672 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-71ba8754-62a2-4812-b888-b0c7b7d434d2 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:40.042424 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-71ba8754-62a2-4812-b888-b0c7b7d434d2 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1186 microversion: 2.1 time: 0.100265 Aug 03 19:07:40.043049 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 168/338] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:39 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1186 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:40.180777 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-ac968247-17bc-4877-bae1-310754b03ce2 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:40.184444 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=100 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:07:40.190042 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-ac968247-17bc-4877-bae1-310754b03ce2 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1713 microversion: 2.1 time: 0.178133 Aug 03 19:07:40.190629 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 171/339] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:40 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1713 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:07:40.929548 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-04d29263-5431-4f40-abb4-e1bb09751a27 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:40.930278 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-04d29263-5431-4f40-abb4-e1bb09751a27 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] [instance: 37a4328e-76ab-4488-9c9f-68e8d817dceb] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:40.936600 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-04d29263-5431-4f40-abb4-e1bb09751a27 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:40.937087 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-04d29263-5431-4f40-abb4-e1bb09751a27 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:40.937849 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-04d29263-5431-4f40-abb4-e1bb09751a27 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:40.938289 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-04d29263-5431-4f40-abb4-e1bb09751a27 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:41.067532 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-791c7cc7-c32a-4bc4-bbcc-76b619798a06 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:41.068359 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-791c7cc7-c32a-4bc4-bbcc-76b619798a06 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:41.076576 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-791c7cc7-c32a-4bc4-bbcc-76b619798a06 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:41.077026 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-791c7cc7-c32a-4bc4-bbcc-76b619798a06 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:41.077798 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-791c7cc7-c32a-4bc4-bbcc-76b619798a06 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:41.078231 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-791c7cc7-c32a-4bc4-bbcc-76b619798a06 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:41.095141 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-04d29263-5431-4f40-abb4-e1bb09751a27 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bfa14ebb124ea8863e8fc5d631c83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7689529c98354844a2c1a0bc0a02cce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:41.107420 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-04d29263-5431-4f40-abb4-e1bb09751a27 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] 10.222.0.77 "GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb" status: 200 len: 1315 microversion: 2.1 time: 0.181540 Aug 03 19:07:41.108210 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 169/340] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:40 2022] GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:41.156967 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-791c7cc7-c32a-4bc4-bbcc-76b619798a06 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:41.172387 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-791c7cc7-c32a-4bc4-bbcc-76b619798a06 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1186 microversion: 2.1 time: 0.108402 Aug 03 19:07:41.173709 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 172/341] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:41 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1186 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:42.133809 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-69039511-3bd5-4803-8cb3-1cb893d68fa4 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:42.135954 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-69039511-3bd5-4803-8cb3-1cb893d68fa4 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] [instance: 37a4328e-76ab-4488-9c9f-68e8d817dceb] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:42.146075 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-69039511-3bd5-4803-8cb3-1cb893d68fa4 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:42.146930 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-69039511-3bd5-4803-8cb3-1cb893d68fa4 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:42.147997 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-69039511-3bd5-4803-8cb3-1cb893d68fa4 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:42.149500 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-69039511-3bd5-4803-8cb3-1cb893d68fa4 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:42.207073 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-9061e892-0073-475f-ac13-6d9056486347 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:42.207704 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-9061e892-0073-475f-ac13-6d9056486347 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:42.222857 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9061e892-0073-475f-ac13-6d9056486347 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:42.223472 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9061e892-0073-475f-ac13-6d9056486347 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:42.224335 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9061e892-0073-475f-ac13-6d9056486347 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:42.224864 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9061e892-0073-475f-ac13-6d9056486347 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:42.303582 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-9061e892-0073-475f-ac13-6d9056486347 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:42.311527 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-9061e892-0073-475f-ac13-6d9056486347 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1194 microversion: 2.1 time: 0.113575 Aug 03 19:07:42.312359 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 173/342] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:42 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1194 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:42.357205 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-69039511-3bd5-4803-8cb3-1cb893d68fa4 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bfa14ebb124ea8863e8fc5d631c83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7689529c98354844a2c1a0bc0a02cce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:42.369692 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-69039511-3bd5-4803-8cb3-1cb893d68fa4 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] 10.222.0.77 "GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb" status: 200 len: 1465 microversion: 2.1 time: 0.243090 Aug 03 19:07:42.384096 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 170/343] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:42 2022] GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb => generated 1465 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:07:42.459304 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-37a77961-05a8-4128-9e9f-78af86c7a828 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:42.463129 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-37a77961-05a8-4128-9e9f-78af86c7a828 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] [instance: 37a4328e-76ab-4488-9c9f-68e8d817dceb] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:42.468638 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-37a77961-05a8-4128-9e9f-78af86c7a828 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:42.469176 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-37a77961-05a8-4128-9e9f-78af86c7a828 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:42.470056 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-37a77961-05a8-4128-9e9f-78af86c7a828 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:42.470503 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-37a77961-05a8-4128-9e9f-78af86c7a828 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:42.499926 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-37a77961-05a8-4128-9e9f-78af86c7a828 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] [instance: 37a4328e-76ab-4488-9c9f-68e8d817dceb] Going to try to terminate instance {{(pid=118303) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 19:07:42.998472 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-37a77961-05a8-4128-9e9f-78af86c7a828 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] 10.222.0.77 "DELETE /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb" status: 204 len: 0 microversion: 2.1 time: 0.543712 Aug 03 19:07:42.999071 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 174/344] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 3 19:07:42 2022] DELETE /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb => generated 0 bytes in 546 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 19:07:43.008734 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-84c3a7ba-3ac8-4dfe-ae3b-fa7660f43676 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:43.009483 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-84c3a7ba-3ac8-4dfe-ae3b-fa7660f43676 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] [instance: 37a4328e-76ab-4488-9c9f-68e8d817dceb] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:43.016150 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-84c3a7ba-3ac8-4dfe-ae3b-fa7660f43676 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:43.016603 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-84c3a7ba-3ac8-4dfe-ae3b-fa7660f43676 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:43.017386 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-84c3a7ba-3ac8-4dfe-ae3b-fa7660f43676 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:43.017828 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-84c3a7ba-3ac8-4dfe-ae3b-fa7660f43676 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:43.194526 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-84c3a7ba-3ac8-4dfe-ae3b-fa7660f43676 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bfa14ebb124ea8863e8fc5d631c83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7689529c98354844a2c1a0bc0a02cce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:43.208453 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-84c3a7ba-3ac8-4dfe-ae3b-fa7660f43676 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] 10.222.0.77 "GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb" status: 200 len: 1471 microversion: 2.1 time: 0.204284 Aug 03 19:07:43.211266 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 171/345] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:43 2022] GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb => generated 1471 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:43.341897 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-49557fe4-5908-42c9-b918-310f74d770a1 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:43.342892 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-49557fe4-5908-42c9-b918-310f74d770a1 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:43.354980 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-49557fe4-5908-42c9-b918-310f74d770a1 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:43.355731 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-49557fe4-5908-42c9-b918-310f74d770a1 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:43.357014 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-49557fe4-5908-42c9-b918-310f74d770a1 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:43.357743 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-49557fe4-5908-42c9-b918-310f74d770a1 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:43.541867 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-49557fe4-5908-42c9-b918-310f74d770a1 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:43.551084 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-49557fe4-5908-42c9-b918-310f74d770a1 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1272 microversion: 2.1 time: 0.217920 Aug 03 19:07:43.552043 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 175/346] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:43 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1272 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:44.240676 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-c3903c94-11a6-437e-83d6-81cb24a5e591 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:44.243059 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-c3903c94-11a6-437e-83d6-81cb24a5e591 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] [instance: 37a4328e-76ab-4488-9c9f-68e8d817dceb] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:44.248920 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c3903c94-11a6-437e-83d6-81cb24a5e591 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:44.249384 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c3903c94-11a6-437e-83d6-81cb24a5e591 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:44.250160 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c3903c94-11a6-437e-83d6-81cb24a5e591 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:44.250596 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c3903c94-11a6-437e-83d6-81cb24a5e591 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:44.429102 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-c3903c94-11a6-437e-83d6-81cb24a5e591 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bfa14ebb124ea8863e8fc5d631c83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7689529c98354844a2c1a0bc0a02cce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:44.442555 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-c3903c94-11a6-437e-83d6-81cb24a5e591 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] 10.222.0.77 "GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb" status: 200 len: 1471 microversion: 2.1 time: 0.205330 Aug 03 19:07:44.443847 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 172/347] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:44 2022] GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb => generated 1471 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:44.577897 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-0dcefe3a-02a9-4406-aa72-e84421c65a69 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:44.579215 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-0dcefe3a-02a9-4406-aa72-e84421c65a69 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:44.596970 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0dcefe3a-02a9-4406-aa72-e84421c65a69 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:44.597495 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0dcefe3a-02a9-4406-aa72-e84421c65a69 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:44.598429 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0dcefe3a-02a9-4406-aa72-e84421c65a69 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:44.598911 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0dcefe3a-02a9-4406-aa72-e84421c65a69 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:44.772636 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-0dcefe3a-02a9-4406-aa72-e84421c65a69 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:44.781775 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-0dcefe3a-02a9-4406-aa72-e84421c65a69 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1272 microversion: 2.1 time: 0.208605 Aug 03 19:07:44.782338 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 176/348] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:44 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1272 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:45.210331 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-53de06d5-d034-4b2e-8413-18621b01acc7 req-79ecf746-95e6-4482-8d30-d08700a72aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c5a48c7-6f8c-4016-9bdc-257578d6c207", "tag": "a29c7b71-aaab-4c8a-afd0-f196f7f95847"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:07:45.223440 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-53de06d5-d034-4b2e-8413-18621b01acc7 req-79ecf746-95e6-4482-8d30-d08700a72aa8 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:45.224191 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-53de06d5-d034-4b2e-8413-18621b01acc7 req-79ecf746-95e6-4482-8d30-d08700a72aa8 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:45.238910 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-53de06d5-d034-4b2e-8413-18621b01acc7 req-79ecf746-95e6-4482-8d30-d08700a72aa8 service nova] Creating event network-changed:a29c7b71-aaab-4c8a-afd0-f196f7f95847 for instance 2c5a48c7-6f8c-4016-9bdc-257578d6c207 on hv-cinder-85202 Aug 03 19:07:45.245761 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-53de06d5-d034-4b2e-8413-18621b01acc7 req-79ecf746-95e6-4482-8d30-d08700a72aa8 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039103 Aug 03 19:07:45.247490 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 173/349] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 19:07:45.482410 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-c977659d-fbe7-4cbb-a6a7-1dbddf7b8934 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:45.483634 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-c977659d-fbe7-4cbb-a6a7-1dbddf7b8934 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] [instance: 37a4328e-76ab-4488-9c9f-68e8d817dceb] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:45.493432 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c977659d-fbe7-4cbb-a6a7-1dbddf7b8934 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:45.494203 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c977659d-fbe7-4cbb-a6a7-1dbddf7b8934 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:45.495388 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c977659d-fbe7-4cbb-a6a7-1dbddf7b8934 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:45.496216 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c977659d-fbe7-4cbb-a6a7-1dbddf7b8934 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:45.670574 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell0:SELECT=2 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:07:45.807842 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-c3454583-50cd-4f15-ab22-98f7f7380b05 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:45.809251 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-c3454583-50cd-4f15-ab22-98f7f7380b05 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:45.825887 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c3454583-50cd-4f15-ab22-98f7f7380b05 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:45.825887 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c3454583-50cd-4f15-ab22-98f7f7380b05 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:45.827112 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-c977659d-fbe7-4cbb-a6a7-1dbddf7b8934 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bfa14ebb124ea8863e8fc5d631c83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7689529c98354844a2c1a0bc0a02cce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:45.828190 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c3454583-50cd-4f15-ab22-98f7f7380b05 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:45.828652 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c3454583-50cd-4f15-ab22-98f7f7380b05 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:45.837590 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-c977659d-fbe7-4cbb-a6a7-1dbddf7b8934 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] 10.222.0.77 "GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb" status: 200 len: 1471 microversion: 2.1 time: 0.361702 Aug 03 19:07:45.838301 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 177/350] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:45 2022] GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb => generated 1471 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:07:46.026649 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-c3454583-50cd-4f15-ab22-98f7f7380b05 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:46.037710 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-c3454583-50cd-4f15-ab22-98f7f7380b05 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1260 microversion: 2.1 time: 0.236309 Aug 03 19:07:46.039085 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 174/351] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:45 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1260 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:46.185263 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [req-0bee02f0-d4c1-4b6e-981f-c049f2ee75c7 req-bee91182-6189-4954-8db7-f6ae44a64f97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a4328e-76ab-4488-9c9f-68e8d817dceb", "name": "network-vif-deleted", "tag": "449a18ec-73f1-4e99-aae8-7d7daf036cd9"}]} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:07:46.207755 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-0bee02f0-d4c1-4b6e-981f-c049f2ee75c7 req-bee91182-6189-4954-8db7-f6ae44a64f97 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:46.208211 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-0bee02f0-d4c1-4b6e-981f-c049f2ee75c7 req-bee91182-6189-4954-8db7-f6ae44a64f97 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:46.236597 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.compute.server_external_events [req-0bee02f0-d4c1-4b6e-981f-c049f2ee75c7 req-bee91182-6189-4954-8db7-f6ae44a64f97 service nova] Creating event network-vif-deleted:449a18ec-73f1-4e99-aae8-7d7daf036cd9 for instance 37a4328e-76ab-4488-9c9f-68e8d817dceb on hv-cinder-85202 Aug 03 19:07:46.246184 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [req-0bee02f0-d4c1-4b6e-981f-c049f2ee75c7 req-bee91182-6189-4954-8db7-f6ae44a64f97 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073152 Aug 03 19:07:46.248490 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 178/352] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:07:46.860213 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell0:SELECT=2 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:07:46.864480 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-e45a4f8f-58ca-43e4-b4f6-9ba8a03db6a4 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:46.865105 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-e45a4f8f-58ca-43e4-b4f6-9ba8a03db6a4 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] [instance: 37a4328e-76ab-4488-9c9f-68e8d817dceb] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:46.867000 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:07:46.872816 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e45a4f8f-58ca-43e4-b4f6-9ba8a03db6a4 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:46.873326 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e45a4f8f-58ca-43e4-b4f6-9ba8a03db6a4 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:46.874099 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e45a4f8f-58ca-43e4-b4f6-9ba8a03db6a4 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:46.874539 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e45a4f8f-58ca-43e4-b4f6-9ba8a03db6a4 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:46.918224 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e45a4f8f-58ca-43e4-b4f6-9ba8a03db6a4 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:46.918937 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e45a4f8f-58ca-43e4-b4f6-9ba8a03db6a4 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:46.919791 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.objects.instance [None req-e45a4f8f-58ca-43e4-b4f6-9ba8a03db6a4 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lazy-loading 'fault' on Instance uuid 37a4328e-76ab-4488-9c9f-68e8d817dceb {{(pid=118302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:07:46.966076 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-e45a4f8f-58ca-43e4-b4f6-9ba8a03db6a4 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bfa14ebb124ea8863e8fc5d631c83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7689529c98354844a2c1a0bc0a02cce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:46.974074 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-e45a4f8f-58ca-43e4-b4f6-9ba8a03db6a4 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] 10.222.0.77 "GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb" status: 200 len: 1305 microversion: 2.1 time: 0.115161 Aug 03 19:07:46.974645 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 175/353] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:46 2022] GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb => generated 1305 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:47.063360 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-6597252d-16a3-4071-86af-c82ccdb0796c tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:47.064127 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-6597252d-16a3-4071-86af-c82ccdb0796c tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:47.070802 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6597252d-16a3-4071-86af-c82ccdb0796c tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:47.071311 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6597252d-16a3-4071-86af-c82ccdb0796c tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:47.072210 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6597252d-16a3-4071-86af-c82ccdb0796c tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:47.072700 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6597252d-16a3-4071-86af-c82ccdb0796c tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:47.240480 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-6597252d-16a3-4071-86af-c82ccdb0796c tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:47.254345 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-6597252d-16a3-4071-86af-c82ccdb0796c tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1260 microversion: 2.1 time: 0.195369 Aug 03 19:07:47.255421 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 179/354] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:47 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1260 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:48.003892 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-9cf6e21c-6f3d-4c50-b5df-4321ab2b2f41 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:48.005051 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-9cf6e21c-6f3d-4c50-b5df-4321ab2b2f41 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] [instance: 37a4328e-76ab-4488-9c9f-68e8d817dceb] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:48.016590 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9cf6e21c-6f3d-4c50-b5df-4321ab2b2f41 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:48.017206 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9cf6e21c-6f3d-4c50-b5df-4321ab2b2f41 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:48.018334 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9cf6e21c-6f3d-4c50-b5df-4321ab2b2f41 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:48.018938 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9cf6e21c-6f3d-4c50-b5df-4321ab2b2f41 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:48.054098 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9cf6e21c-6f3d-4c50-b5df-4321ab2b2f41 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:48.054098 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9cf6e21c-6f3d-4c50-b5df-4321ab2b2f41 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:48.054576 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.objects.instance [None req-9cf6e21c-6f3d-4c50-b5df-4321ab2b2f41 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lazy-loading 'fault' on Instance uuid 37a4328e-76ab-4488-9c9f-68e8d817dceb {{(pid=118302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:07:48.100420 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-9cf6e21c-6f3d-4c50-b5df-4321ab2b2f41 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bfa14ebb124ea8863e8fc5d631c83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7689529c98354844a2c1a0bc0a02cce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:48.109456 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-9cf6e21c-6f3d-4c50-b5df-4321ab2b2f41 tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] 10.222.0.77 "GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb" status: 200 len: 1305 microversion: 2.1 time: 0.113526 Aug 03 19:07:48.110034 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 176/355] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:47 2022] GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb => generated 1305 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:48.274549 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell0:SELECT=8 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:07:48.280351 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-3c8c02cd-c7b1-4460-92e1-36088d640f0a tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:48.280957 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-3c8c02cd-c7b1-4460-92e1-36088d640f0a tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:48.289206 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3c8c02cd-c7b1-4460-92e1-36088d640f0a tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:48.290362 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3c8c02cd-c7b1-4460-92e1-36088d640f0a tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:48.291251 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3c8c02cd-c7b1-4460-92e1-36088d640f0a tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:48.291698 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3c8c02cd-c7b1-4460-92e1-36088d640f0a tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:48.454042 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-3c8c02cd-c7b1-4460-92e1-36088d640f0a tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:48.462398 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-3c8c02cd-c7b1-4460-92e1-36088d640f0a tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1260 microversion: 2.1 time: 0.188744 Aug 03 19:07:48.463321 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 180/356] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:48 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1260 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:49.133017 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-63144bc9-b522-49a1-95e6-b4c3588e902b tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:49.134805 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-63144bc9-b522-49a1-95e6-b4c3588e902b tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] [instance: 37a4328e-76ab-4488-9c9f-68e8d817dceb] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:49.142359 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-63144bc9-b522-49a1-95e6-b4c3588e902b tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:49.142977 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-63144bc9-b522-49a1-95e6-b4c3588e902b tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:49.144075 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-63144bc9-b522-49a1-95e6-b4c3588e902b tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:49.144616 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-63144bc9-b522-49a1-95e6-b4c3588e902b tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:49.182157 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-63144bc9-b522-49a1-95e6-b4c3588e902b tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:49.182641 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-63144bc9-b522-49a1-95e6-b4c3588e902b tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:49.183144 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.objects.instance [None req-63144bc9-b522-49a1-95e6-b4c3588e902b tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lazy-loading 'fault' on Instance uuid 37a4328e-76ab-4488-9c9f-68e8d817dceb {{(pid=118302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:07:49.231766 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-63144bc9-b522-49a1-95e6-b4c3588e902b tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bfa14ebb124ea8863e8fc5d631c83a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7689529c98354844a2c1a0bc0a02cce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:49.240193 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-63144bc9-b522-49a1-95e6-b4c3588e902b tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] 10.222.0.77 "GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb" status: 200 len: 1305 microversion: 2.1 time: 0.112484 Aug 03 19:07:49.240784 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 177/357] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:49 2022] GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb => generated 1305 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:49.485562 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-960b41a3-d337-417d-bf07-2fea7ae81063 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:49.486412 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-960b41a3-d337-417d-bf07-2fea7ae81063 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:49.493722 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-960b41a3-d337-417d-bf07-2fea7ae81063 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:49.494178 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-960b41a3-d337-417d-bf07-2fea7ae81063 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:49.494966 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-960b41a3-d337-417d-bf07-2fea7ae81063 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:49.495454 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-960b41a3-d337-417d-bf07-2fea7ae81063 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:49.636753 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-960b41a3-d337-417d-bf07-2fea7ae81063 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:49.644698 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-960b41a3-d337-417d-bf07-2fea7ae81063 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1260 microversion: 2.1 time: 0.164043 Aug 03 19:07:49.645267 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 181/358] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:49 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:50.268654 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-1eedff4d-ffa9-44cf-8ec9-d2c2ed5901ba tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:50.269352 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-1eedff4d-ffa9-44cf-8ec9-d2c2ed5901ba tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] [instance: 37a4328e-76ab-4488-9c9f-68e8d817dceb] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:50.276290 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1eedff4d-ffa9-44cf-8ec9-d2c2ed5901ba tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:50.276735 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1eedff4d-ffa9-44cf-8ec9-d2c2ed5901ba tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:50.277511 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1eedff4d-ffa9-44cf-8ec9-d2c2ed5901ba tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:50.277957 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1eedff4d-ffa9-44cf-8ec9-d2c2ed5901ba tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:50.294725 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.wsgi [None req-1eedff4d-ffa9-44cf-8ec9-d2c2ed5901ba tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] HTTP exception thrown: Instance 37a4328e-76ab-4488-9c9f-68e8d817dceb could not be found. Aug 03 19:07:50.296416 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-1eedff4d-ffa9-44cf-8ec9-d2c2ed5901ba tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Request method failure captured: Aug 03 19:07:50.296416 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: request: GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb HTTP/1.1 Aug 03 19:07:50.296416 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept: application/json Aug 03 19:07:50.296416 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept-Encoding: identity Aug 03 19:07:50.296416 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Connection: close Aug 03 19:07:50.296416 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Length: 0 Aug 03 19:07:50.296416 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Type: application/json Aug 03 19:07:50.296416 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Host: 10.222.0.77 Aug 03 19:07:50.296416 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Openstack-System-Scope: None Aug 03 19:07:50.296416 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: User-Agent: python-urllib3/1.26.11 Aug 03 19:07:50.296416 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Auth-Token: gAAAAABi6sdmu4FgnSs6KHoJxdaSCqFzu5jLSOKPhXy_ctcf96q4XqMNFAzCPC4lLX8VeeqTXhCkZLlHKh3XHJW-J74FlZiP-bmRwp309qyWcV-zHF58AnlEMnHktHxqUl5pSh9IKf9JK0kebxrWZQgyXoaHjqe1JOdb-2OfNDFRBXeKAw3qM3s Aug 03 19:07:50.296416 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Id: None Aug 03 19:07:50.296416 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Name: None Aug 03 19:07:50.296416 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Identity-Status: Confirmed Aug 03 19:07:50.296416 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Is-Admin-Project: True Aug 03 19:07:50.296416 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Id: default Aug 03 19:07:50.296416 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Name: Default Aug 03 19:07:50.296416 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Id: 7689529c98354844a2c1a0bc0a02cce6 Aug 03 19:07:50.296416 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Name: tempest-VolumesNegativeTest-1596953667 Aug 03 19:07:50.296416 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Role: reader,member Aug 03 19:07:50.296416 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Roles: reader,member Aug 03 19:07:50.299709 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_7689529c98354844a2c1a0bc0a02cce6", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/7689529c98354844a2c1a0bc0a02cce6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/7689529c98354844a2c1a0bc0a02cce6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/7689529c98354844a2c1a0bc0a02cce6"}]}] Aug 03 19:07:50.299709 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant: tempest-VolumesNegativeTest-1596953667 Aug 03 19:07:50.299709 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Id: 7689529c98354844a2c1a0bc0a02cce6 Aug 03 19:07:50.299709 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Name: tempest-VolumesNegativeTest-1596953667 Aug 03 19:07:50.299709 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User: tempest-VolumesNegativeTest-1596953667-project Aug 03 19:07:50.299709 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Id: default Aug 03 19:07:50.299709 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Name: Default Aug 03 19:07:50.299709 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Id: c2bfa14ebb124ea8863e8fc5d631c83a Aug 03 19:07:50.299709 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Name: tempest-VolumesNegativeTest-1596953667-project Aug 03 19:07:50.299709 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: method: > Aug 03 19:07:50.299709 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: exception: Instance 37a4328e-76ab-4488-9c9f-68e8d817dceb could not be found. Aug 03 19:07:50.299709 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: action_args: {'id': '37a4328e-76ab-4488-9c9f-68e8d817dceb'} Aug 03 19:07:50.301202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:07:50.301202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:07:50.301202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:07:50.301202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:07:50.301202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:07:50.301202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:07:50.301202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:07:50.301202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:07:50.301202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:07:50.301202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:07:50.301202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37a4328e-76ab-4488-9c9f-68e8d817dceb could not be found. Aug 03 19:07:50.301202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:07:50.301202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:07:50.301202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:07:50.301202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:07:50.301202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:07:50.301202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:07:50.301202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:07:50.301202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:07:50.301202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:07:50.303269 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:07:50.303269 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:07:50.303269 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:07:50.303269 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:07:50.303269 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:07:50.303269 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:07:50.303269 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:07:50.303269 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37a4328e-76ab-4488-9c9f-68e8d817dceb could not be found. Aug 03 19:07:50.303269 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:07:50.303269 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:07:50.303269 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:07:50.303269 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:07:50.303269 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:07:50.303269 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:07:50.303269 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:07:50.303269 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:07:50.303269 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37a4328e-76ab-4488-9c9f-68e8d817dceb could not be found. Aug 03 19:07:50.303269 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:07:50.304475 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-1eedff4d-ffa9-44cf-8ec9-d2c2ed5901ba tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] Returning 404 to user: Instance 37a4328e-76ab-4488-9c9f-68e8d817dceb could not be found. {{(pid=118302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:07:50.304475 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-1eedff4d-ffa9-44cf-8ec9-d2c2ed5901ba tempest-VolumesNegativeTest-1596953667 tempest-VolumesNegativeTest-1596953667-project] 10.222.0.77 "GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb" status: 404 len: 111 microversion: 2.1 time: 0.033188 Aug 03 19:07:50.304475 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 178/359] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:50 2022] GET /compute/v2.1/servers/37a4328e-76ab-4488-9c9f-68e8d817dceb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:07:50.669539 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-eef3a769-ead8-415a-b2bc-826fa5db55f1 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:50.670136 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-eef3a769-ead8-415a-b2bc-826fa5db55f1 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:50.677173 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-eef3a769-ead8-415a-b2bc-826fa5db55f1 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:50.677626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-eef3a769-ead8-415a-b2bc-826fa5db55f1 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:50.678400 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-eef3a769-ead8-415a-b2bc-826fa5db55f1 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:50.678835 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-eef3a769-ead8-415a-b2bc-826fa5db55f1 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:50.889300 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-eef3a769-ead8-415a-b2bc-826fa5db55f1 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:50.899533 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-eef3a769-ead8-415a-b2bc-826fa5db55f1 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1260 microversion: 2.1 time: 0.236440 Aug 03 19:07:50.900324 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 182/360] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:50 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1260 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:51.123490 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-b2fe7169-ff8b-423a-b996-683b47646217 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-400721132", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1132387639", "security_groups": [{"name": "tempest-secgroup-smoke-499638857"}], "block_device_mapping_v2": [{"uuid": "7961a1c8-5a96-4c48-9ac9-1226bec7c278", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9ccc48a3-6dd8-4736-87f7-cf1e5f400519"}]}} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:07:51.284040 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.network.neutron [None req-b2fe7169-ff8b-423a-b996-683b47646217 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] validate_networks() for [('9ccc48a3-6dd8-4736-87f7-cf1e5f400519', None, None, None, None, None)] {{(pid=118302) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 19:07:51.780113 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-b2fe7169-ff8b-423a-b996-683b47646217 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Flavor limits 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 19:07:51.780965 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-b2fe7169-ff8b-423a-b996-683b47646217 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Image limits 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 19:07:51.781834 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-b2fe7169-ff8b-423a-b996-683b47646217 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Flavor pref 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 19:07:51.782197 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-b2fe7169-ff8b-423a-b996-683b47646217 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Image pref 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 19:07:51.782936 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-b2fe7169-ff8b-423a-b996-683b47646217 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 19:07:51.797997 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b2fe7169-ff8b-423a-b996-683b47646217 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:51.798568 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b2fe7169-ff8b-423a-b996-683b47646217 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:51.799784 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b2fe7169-ff8b-423a-b996-683b47646217 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:51.800453 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b2fe7169-ff8b-423a-b996-683b47646217 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:51.827014 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.quota [None req-b2fe7169-ff8b-423a-b996-683b47646217 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Getting quotas for project 28d15350ea8f45b490bb080384999f4b. Resources: {'instances', 'cores', 'ram'} {{(pid=118302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:07:51.833413 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.quota [None req-b2fe7169-ff8b-423a-b996-683b47646217 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Getting quotas for user 626fe64980ed40d4bbb829c75dc0067c and project 28d15350ea8f45b490bb080384999f4b. Resources: {'instances', 'cores', 'ram'} {{(pid=118302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:07:51.923207 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-b2fe7169-ff8b-423a-b996-683b47646217 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Going to run 1 instances... {{(pid=118302) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 19:07:51.928104 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-b2fe7169-ff8b-423a-b996-683b47646217 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: 483630e6-3fee-46ff-8bd2-5031a27f8696] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7961a1c8-5a96-4c48-9ac9-1226bec7c278',volume_size=None,volume_type=None)] {{(pid=118302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 19:07:51.928965 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-cf2bd159-a56f-4bff-90ed-9892406d4097 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:51.929782 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-cf2bd159-a56f-4bff-90ed-9892406d4097 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:51.935192 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:07:51.940755 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cf2bd159-a56f-4bff-90ed-9892406d4097 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:51.941337 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cf2bd159-a56f-4bff-90ed-9892406d4097 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:51.943097 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cf2bd159-a56f-4bff-90ed-9892406d4097 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:51.944217 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cf2bd159-a56f-4bff-90ed-9892406d4097 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:52.136166 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-cf2bd159-a56f-4bff-90ed-9892406d4097 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:52.145055 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-cf2bd159-a56f-4bff-90ed-9892406d4097 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1260 microversion: 2.1 time: 0.223073 Aug 03 19:07:52.147789 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 183/361] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:51 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1260 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:52.536054 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-b2fe7169-ff8b-423a-b996-683b47646217 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.419255 Aug 03 19:07:52.537486 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 179/362] 10.222.0.77 () {60 vars in 1147 bytes} [Wed Aug 3 19:07:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 1421 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 19:07:52.548311 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-777c5b7a-708a-4f61-b687-b0ea42774861 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:52.556548 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-777c5b7a-708a-4f61-b687-b0ea42774861 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: 483630e6-3fee-46ff-8bd2-5031a27f8696] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:52.610120 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-777c5b7a-708a-4f61-b687-b0ea42774861 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:52.618696 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-777c5b7a-708a-4f61-b687-b0ea42774861 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696" status: 200 len: 1094 microversion: 2.1 time: 0.074646 Aug 03 19:07:52.619378 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 184/363] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:52 2022] GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696 => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:53.167850 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-c9841352-211c-4d36-a1d2-917a4a080df0 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:53.168691 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-c9841352-211c-4d36-a1d2-917a4a080df0 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:53.175897 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c9841352-211c-4d36-a1d2-917a4a080df0 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:53.176404 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c9841352-211c-4d36-a1d2-917a4a080df0 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:53.177225 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c9841352-211c-4d36-a1d2-917a4a080df0 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:53.177843 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c9841352-211c-4d36-a1d2-917a4a080df0 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:53.209170 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=100 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:07:53.351743 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-c9841352-211c-4d36-a1d2-917a4a080df0 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:53.359724 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-c9841352-211c-4d36-a1d2-917a4a080df0 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1260 microversion: 2.1 time: 0.196890 Aug 03 19:07:53.365402 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 180/364] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:53 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1260 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:53.641704 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-1b61e9aa-c652-4da2-8d3e-b83ae50cfb34 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:53.642502 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-1b61e9aa-c652-4da2-8d3e-b83ae50cfb34 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: 483630e6-3fee-46ff-8bd2-5031a27f8696] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:53.700387 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-1b61e9aa-c652-4da2-8d3e-b83ae50cfb34 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:53.708368 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-1b61e9aa-c652-4da2-8d3e-b83ae50cfb34 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696" status: 200 len: 1094 microversion: 2.1 time: 0.070467 Aug 03 19:07:53.708835 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 185/365] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:53 2022] GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:54.382717 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-37f23ec8-00db-4260-93ae-146acd2b8f0d tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:54.383595 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-37f23ec8-00db-4260-93ae-146acd2b8f0d tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:54.392430 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-37f23ec8-00db-4260-93ae-146acd2b8f0d tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:54.392888 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-37f23ec8-00db-4260-93ae-146acd2b8f0d tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:54.393751 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-37f23ec8-00db-4260-93ae-146acd2b8f0d tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:54.394249 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-37f23ec8-00db-4260-93ae-146acd2b8f0d tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:54.548946 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-37f23ec8-00db-4260-93ae-146acd2b8f0d tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:54.557444 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-37f23ec8-00db-4260-93ae-146acd2b8f0d tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1260 microversion: 2.1 time: 0.179260 Aug 03 19:07:54.558016 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 181/366] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:54 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:54.737465 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-3e21ef1a-07b9-4cba-a1ff-99a55b69f416 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:54.738299 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-3e21ef1a-07b9-4cba-a1ff-99a55b69f416 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: 483630e6-3fee-46ff-8bd2-5031a27f8696] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:54.745848 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3e21ef1a-07b9-4cba-a1ff-99a55b69f416 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:54.746303 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3e21ef1a-07b9-4cba-a1ff-99a55b69f416 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:54.747189 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3e21ef1a-07b9-4cba-a1ff-99a55b69f416 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:54.747628 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3e21ef1a-07b9-4cba-a1ff-99a55b69f416 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:54.818050 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-3e21ef1a-07b9-4cba-a1ff-99a55b69f416 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:54.827350 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-3e21ef1a-07b9-4cba-a1ff-99a55b69f416 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696" status: 200 len: 1144 microversion: 2.1 time: 0.094584 Aug 03 19:07:54.828973 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 186/367] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:54 2022] GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696 => generated 1144 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:55.578710 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-6a34568c-0061-4242-9774-d8aac19cec94 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:55.583097 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-6a34568c-0061-4242-9774-d8aac19cec94 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:55.586466 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-6a34568c-0061-4242-9774-d8aac19cec94 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:55.587164 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-6a34568c-0061-4242-9774-d8aac19cec94 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:55.587947 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-6a34568c-0061-4242-9774-d8aac19cec94 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:55.588388 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-6a34568c-0061-4242-9774-d8aac19cec94 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:55.850911 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-72154160-95ef-4586-8332-9c57400cb37f tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:55.853160 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-72154160-95ef-4586-8332-9c57400cb37f tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: 483630e6-3fee-46ff-8bd2-5031a27f8696] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:55.863824 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-72154160-95ef-4586-8332-9c57400cb37f tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:55.864931 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-72154160-95ef-4586-8332-9c57400cb37f tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:55.866592 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-72154160-95ef-4586-8332-9c57400cb37f tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:55.867341 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-72154160-95ef-4586-8332-9c57400cb37f tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:55.964604 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-6a34568c-0061-4242-9774-d8aac19cec94 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:55.994775 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-72154160-95ef-4586-8332-9c57400cb37f tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:56.004772 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-6a34568c-0061-4242-9774-d8aac19cec94 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1260 microversion: 2.1 time: 0.429132 Aug 03 19:07:56.005716 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 182/368] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:55 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1260 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:56.005993 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-72154160-95ef-4586-8332-9c57400cb37f tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696" status: 200 len: 1192 microversion: 2.1 time: 0.159372 Aug 03 19:07:56.006812 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 187/369] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:55 2022] GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696 => generated 1192 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:07:57.029594 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-92a45497-d198-4330-ae27-d869c7edfbb9 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:57.030834 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-92a45497-d198-4330-ae27-d869c7edfbb9 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:57.033808 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-e6920581-9291-4f2a-b853-755d1d671598 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:57.040527 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-e6920581-9291-4f2a-b853-755d1d671598 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: 483630e6-3fee-46ff-8bd2-5031a27f8696] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:57.040806 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-92a45497-d198-4330-ae27-d869c7edfbb9 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:57.040806 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-92a45497-d198-4330-ae27-d869c7edfbb9 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:57.040806 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-92a45497-d198-4330-ae27-d869c7edfbb9 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:57.040806 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-92a45497-d198-4330-ae27-d869c7edfbb9 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:57.043534 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e6920581-9291-4f2a-b853-755d1d671598 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:57.044068 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e6920581-9291-4f2a-b853-755d1d671598 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:57.045045 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e6920581-9291-4f2a-b853-755d1d671598 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:57.045658 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e6920581-9291-4f2a-b853-755d1d671598 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:57.250662 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-e6920581-9291-4f2a-b853-755d1d671598 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:57.261143 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-e6920581-9291-4f2a-b853-755d1d671598 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696" status: 200 len: 1210 microversion: 2.1 time: 0.231359 Aug 03 19:07:57.262354 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 188/370] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:57 2022] GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696 => generated 1210 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:57.292789 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-92a45497-d198-4330-ae27-d869c7edfbb9 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:57.306230 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-92a45497-d198-4330-ae27-d869c7edfbb9 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1260 microversion: 2.1 time: 0.280553 Aug 03 19:07:57.307485 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 183/371] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:57 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1260 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:58.291928 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-b4994782-a76f-4317-a70b-b68d30fe7da1 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:58.291928 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-b4994782-a76f-4317-a70b-b68d30fe7da1 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: 483630e6-3fee-46ff-8bd2-5031a27f8696] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:58.300508 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b4994782-a76f-4317-a70b-b68d30fe7da1 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:58.301809 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b4994782-a76f-4317-a70b-b68d30fe7da1 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:58.302848 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b4994782-a76f-4317-a70b-b68d30fe7da1 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:58.303577 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b4994782-a76f-4317-a70b-b68d30fe7da1 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:58.318449 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-795f6fd3-25a8-4719-992a-000be2060716 req-d476021b-737b-43d4-8f9b-a53c985936ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c5a48c7-6f8c-4016-9bdc-257578d6c207", "name": "network-vif-plugged", "status": "completed", "tag": "a29c7b71-aaab-4c8a-afd0-f196f7f95847"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:07:58.334488 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-795f6fd3-25a8-4719-992a-000be2060716 req-d476021b-737b-43d4-8f9b-a53c985936ba service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:58.335169 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-795f6fd3-25a8-4719-992a-000be2060716 req-d476021b-737b-43d4-8f9b-a53c985936ba service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:58.347645 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:07:58.350679 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-795f6fd3-25a8-4719-992a-000be2060716 req-d476021b-737b-43d4-8f9b-a53c985936ba service nova] Creating event network-vif-plugged:a29c7b71-aaab-4c8a-afd0-f196f7f95847 for instance 2c5a48c7-6f8c-4016-9bdc-257578d6c207 on hv-cinder-85202 Aug 03 19:07:58.357005 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-795f6fd3-25a8-4719-992a-000be2060716 req-d476021b-737b-43d4-8f9b-a53c985936ba service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047750 Aug 03 19:07:58.362290 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 184/372] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:07:58.369457 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-95c958d8-0c83-438a-bac1-4cb8d3ce79e6 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:58.370974 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-95c958d8-0c83-438a-bac1-4cb8d3ce79e6 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:58.379926 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-95c958d8-0c83-438a-bac1-4cb8d3ce79e6 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:58.381005 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-95c958d8-0c83-438a-bac1-4cb8d3ce79e6 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:58.382022 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-95c958d8-0c83-438a-bac1-4cb8d3ce79e6 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:58.382541 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-95c958d8-0c83-438a-bac1-4cb8d3ce79e6 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:58.592795 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-b4994782-a76f-4317-a70b-b68d30fe7da1 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:58.605547 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-b4994782-a76f-4317-a70b-b68d30fe7da1 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696" status: 200 len: 1277 microversion: 2.1 time: 0.323248 Aug 03 19:07:58.606135 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 189/373] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:58 2022] GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696 => generated 1277 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:07:58.629161 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-95c958d8-0c83-438a-bac1-4cb8d3ce79e6 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:58.637965 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-95c958d8-0c83-438a-bac1-4cb8d3ce79e6 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1260 microversion: 2.1 time: 0.274214 Aug 03 19:07:58.638791 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 185/374] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:58 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1260 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:59.008504 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [req-2798aa52-93fe-4606-be87-aea959e95708 req-1ecdb635-b9ad-4b80-a4c5-25dba0f929c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "483630e6-3fee-46ff-8bd2-5031a27f8696", "tag": "14e45674-2652-4efa-9368-ed9ccf397690"}]} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:07:59.028865 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-2798aa52-93fe-4606-be87-aea959e95708 req-1ecdb635-b9ad-4b80-a4c5-25dba0f929c1 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:59.031889 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-2798aa52-93fe-4606-be87-aea959e95708 req-1ecdb635-b9ad-4b80-a4c5-25dba0f929c1 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:59.044638 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.compute.server_external_events [req-2798aa52-93fe-4606-be87-aea959e95708 req-1ecdb635-b9ad-4b80-a4c5-25dba0f929c1 service nova] Creating event network-changed:14e45674-2652-4efa-9368-ed9ccf397690 for instance 483630e6-3fee-46ff-8bd2-5031a27f8696 on hv-cinder-85202 Aug 03 19:07:59.050011 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [req-2798aa52-93fe-4606-be87-aea959e95708 req-1ecdb635-b9ad-4b80-a4c5-25dba0f929c1 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046365 Aug 03 19:07:59.050862 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 190/375] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 19:07:59.637310 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-45e6b2f6-2586-482b-960a-1fba128a4e9e tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:59.637933 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-45e6b2f6-2586-482b-960a-1fba128a4e9e tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: 483630e6-3fee-46ff-8bd2-5031a27f8696] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:59.646285 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-45e6b2f6-2586-482b-960a-1fba128a4e9e tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:59.646746 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-45e6b2f6-2586-482b-960a-1fba128a4e9e tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:59.647576 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-45e6b2f6-2586-482b-960a-1fba128a4e9e tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:59.648021 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-45e6b2f6-2586-482b-960a-1fba128a4e9e tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:59.663545 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-8286f950-2780-4968-ba1e-7f19b6afe5b8 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:59.665806 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-8286f950-2780-4968-ba1e-7f19b6afe5b8 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:59.677060 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8286f950-2780-4968-ba1e-7f19b6afe5b8 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:59.679520 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8286f950-2780-4968-ba1e-7f19b6afe5b8 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:59.679520 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8286f950-2780-4968-ba1e-7f19b6afe5b8 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:59.680455 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8286f950-2780-4968-ba1e-7f19b6afe5b8 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:59.887428 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-8286f950-2780-4968-ba1e-7f19b6afe5b8 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:59.891803 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-45e6b2f6-2586-482b-960a-1fba128a4e9e tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:59.896004 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-8286f950-2780-4968-ba1e-7f19b6afe5b8 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1260 microversion: 2.1 time: 0.241025 Aug 03 19:07:59.896667 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 191/376] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:59 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1260 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:07:59.900093 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-45e6b2f6-2586-482b-960a-1fba128a4e9e tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696" status: 200 len: 1265 microversion: 2.1 time: 0.266615 Aug 03 19:07:59.900856 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 186/377] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:59 2022] GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696 => generated 1265 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:08:00.918012 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-04ff2419-541b-4fd3-bd82-f1f0ad2099a8 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:00.919248 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-04ff2419-541b-4fd3-bd82-f1f0ad2099a8 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:00.921745 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-f9034838-decd-439c-a611-ee41b708ad3a tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:00.922397 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-f9034838-decd-439c-a611-ee41b708ad3a tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: 483630e6-3fee-46ff-8bd2-5031a27f8696] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:00.929217 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f9034838-decd-439c-a611-ee41b708ad3a tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:00.929674 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f9034838-decd-439c-a611-ee41b708ad3a tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:00.931181 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-04ff2419-541b-4fd3-bd82-f1f0ad2099a8 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:00.931544 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f9034838-decd-439c-a611-ee41b708ad3a tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:00.931957 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-04ff2419-541b-4fd3-bd82-f1f0ad2099a8 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:00.932497 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f9034838-decd-439c-a611-ee41b708ad3a tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:00.933241 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-04ff2419-541b-4fd3-bd82-f1f0ad2099a8 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:00.933241 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-04ff2419-541b-4fd3-bd82-f1f0ad2099a8 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:01.147364 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-04ff2419-541b-4fd3-bd82-f1f0ad2099a8 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:01.156504 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-04ff2419-541b-4fd3-bd82-f1f0ad2099a8 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1443 microversion: 2.1 time: 0.242528 Aug 03 19:08:01.157074 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 192/378] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:00 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1443 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:08:01.170399 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-f9034838-decd-439c-a611-ee41b708ad3a tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:01.178644 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-f9034838-decd-439c-a611-ee41b708ad3a tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696" status: 200 len: 1265 microversion: 2.1 time: 0.260835 Aug 03 19:08:01.179433 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 187/379] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:00 2022] GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696 => generated 1265 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:08:01.197039 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-44088500-9abc-41ed-9c08-3a275a652af9 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:01.197656 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-44088500-9abc-41ed-9c08-3a275a652af9 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:01.205402 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-44088500-9abc-41ed-9c08-3a275a652af9 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:01.206127 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-44088500-9abc-41ed-9c08-3a275a652af9 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:01.207544 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-44088500-9abc-41ed-9c08-3a275a652af9 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:01.208296 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-44088500-9abc-41ed-9c08-3a275a652af9 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:01.424859 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-44088500-9abc-41ed-9c08-3a275a652af9 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:01.432955 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-44088500-9abc-41ed-9c08-3a275a652af9 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1443 microversion: 2.1 time: 0.240213 Aug 03 19:08:01.433536 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 193/380] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:01 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1443 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:08:02.202013 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-362154fa-d9da-4deb-96ff-52edf616ec95 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:02.202879 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-362154fa-d9da-4deb-96ff-52edf616ec95 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: 483630e6-3fee-46ff-8bd2-5031a27f8696] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:02.204766 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell0:SELECT=2 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:08:02.205437 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell0:SELECT=6 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:08:02.211481 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-362154fa-d9da-4deb-96ff-52edf616ec95 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:02.212096 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-362154fa-d9da-4deb-96ff-52edf616ec95 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:02.212978 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-362154fa-d9da-4deb-96ff-52edf616ec95 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:02.213447 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-362154fa-d9da-4deb-96ff-52edf616ec95 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:02.404067 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-362154fa-d9da-4deb-96ff-52edf616ec95 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:02.413017 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-362154fa-d9da-4deb-96ff-52edf616ec95 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696" status: 200 len: 1265 microversion: 2.1 time: 0.214716 Aug 03 19:08:02.413773 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 188/381] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:02 2022] GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696 => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:08:03.435694 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-04504b21-66f0-47b8-8eb0-dc61f0da77f9 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:03.436466 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-04504b21-66f0-47b8-8eb0-dc61f0da77f9 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: 483630e6-3fee-46ff-8bd2-5031a27f8696] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:03.444218 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-04504b21-66f0-47b8-8eb0-dc61f0da77f9 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:03.444967 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-04504b21-66f0-47b8-8eb0-dc61f0da77f9 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:03.446463 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-04504b21-66f0-47b8-8eb0-dc61f0da77f9 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:03.447021 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-04504b21-66f0-47b8-8eb0-dc61f0da77f9 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:03.606405 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-04504b21-66f0-47b8-8eb0-dc61f0da77f9 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:03.615165 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-04504b21-66f0-47b8-8eb0-dc61f0da77f9 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696" status: 200 len: 1265 microversion: 2.1 time: 0.183705 Aug 03 19:08:03.615798 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 194/382] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:03 2022] GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:08:04.021700 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-796eb7d4-3d89-41df-b22c-d5bbf5a6ff04 req-3b686558-e6a1-4055-9ae5-543d0172b3c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c5a48c7-6f8c-4016-9bdc-257578d6c207", "tag": "a29c7b71-aaab-4c8a-afd0-f196f7f95847"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:08:04.034459 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-796eb7d4-3d89-41df-b22c-d5bbf5a6ff04 req-3b686558-e6a1-4055-9ae5-543d0172b3c3 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:04.035469 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-796eb7d4-3d89-41df-b22c-d5bbf5a6ff04 req-3b686558-e6a1-4055-9ae5-543d0172b3c3 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:04.049887 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-796eb7d4-3d89-41df-b22c-d5bbf5a6ff04 req-3b686558-e6a1-4055-9ae5-543d0172b3c3 service nova] Creating event network-changed:a29c7b71-aaab-4c8a-afd0-f196f7f95847 for instance 2c5a48c7-6f8c-4016-9bdc-257578d6c207 on hv-cinder-85202 Aug 03 19:08:04.055938 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-796eb7d4-3d89-41df-b22c-d5bbf5a6ff04 req-3b686558-e6a1-4055-9ae5-543d0172b3c3 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037699 Aug 03 19:08:04.056611 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 189/383] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:08:04.640163 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-a7dfbbf2-d4cf-40b1-8321-bd5f2436c923 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:04.646442 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-a7dfbbf2-d4cf-40b1-8321-bd5f2436c923 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: 483630e6-3fee-46ff-8bd2-5031a27f8696] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:04.646442 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell0:SELECT=4 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:08:04.649766 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a7dfbbf2-d4cf-40b1-8321-bd5f2436c923 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:04.650246 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a7dfbbf2-d4cf-40b1-8321-bd5f2436c923 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:04.651166 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a7dfbbf2-d4cf-40b1-8321-bd5f2436c923 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:04.651618 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a7dfbbf2-d4cf-40b1-8321-bd5f2436c923 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:04.918084 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-a7dfbbf2-d4cf-40b1-8321-bd5f2436c923 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:04.932167 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-a7dfbbf2-d4cf-40b1-8321-bd5f2436c923 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696" status: 200 len: 1265 microversion: 2.1 time: 0.293282 Aug 03 19:08:04.932167 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 195/384] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:04 2022] GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696 => generated 1265 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:08:05.950467 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-d52c96f9-11b0-4d79-92c5-080ab32df728 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:05.951188 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-d52c96f9-11b0-4d79-92c5-080ab32df728 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: 483630e6-3fee-46ff-8bd2-5031a27f8696] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:05.958381 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d52c96f9-11b0-4d79-92c5-080ab32df728 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:05.958828 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d52c96f9-11b0-4d79-92c5-080ab32df728 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:05.959660 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d52c96f9-11b0-4d79-92c5-080ab32df728 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:05.960109 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d52c96f9-11b0-4d79-92c5-080ab32df728 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:06.102210 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-d52c96f9-11b0-4d79-92c5-080ab32df728 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:06.109936 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-d52c96f9-11b0-4d79-92c5-080ab32df728 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696" status: 200 len: 1265 microversion: 2.1 time: 0.163852 Aug 03 19:08:06.110505 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 190/385] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:05 2022] GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:08:07.136769 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-f519f2f7-d2ef-44f3-ad16-04efbc49c4e6 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:07.137321 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-f519f2f7-d2ef-44f3-ad16-04efbc49c4e6 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: 483630e6-3fee-46ff-8bd2-5031a27f8696] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:07.144109 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f519f2f7-d2ef-44f3-ad16-04efbc49c4e6 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:07.144624 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f519f2f7-d2ef-44f3-ad16-04efbc49c4e6 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:07.145322 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f519f2f7-d2ef-44f3-ad16-04efbc49c4e6 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:07.145752 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f519f2f7-d2ef-44f3-ad16-04efbc49c4e6 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:07.302418 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-f519f2f7-d2ef-44f3-ad16-04efbc49c4e6 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:07.313105 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-f519f2f7-d2ef-44f3-ad16-04efbc49c4e6 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696" status: 200 len: 1265 microversion: 2.1 time: 0.185492 Aug 03 19:08:07.313890 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 196/386] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:07 2022] GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:08:08.336219 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-87b319bc-be0c-4649-a876-d8b1b651641d tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:08.336976 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-87b319bc-be0c-4649-a876-d8b1b651641d tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: 483630e6-3fee-46ff-8bd2-5031a27f8696] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:08.343741 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-87b319bc-be0c-4649-a876-d8b1b651641d tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:08.344190 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-87b319bc-be0c-4649-a876-d8b1b651641d tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:08.344967 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-87b319bc-be0c-4649-a876-d8b1b651641d tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:08.345403 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-87b319bc-be0c-4649-a876-d8b1b651641d tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:08.486204 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-87b319bc-be0c-4649-a876-d8b1b651641d tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:08.494724 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-87b319bc-be0c-4649-a876-d8b1b651641d tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696" status: 200 len: 1265 microversion: 2.1 time: 0.162615 Aug 03 19:08:08.495350 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 191/387] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:08 2022] GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:08:09.518554 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-d934abff-d64f-4a66-a6a4-0bf5e11548d3 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:09.519575 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-d934abff-d64f-4a66-a6a4-0bf5e11548d3 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: 483630e6-3fee-46ff-8bd2-5031a27f8696] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:09.530483 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d934abff-d64f-4a66-a6a4-0bf5e11548d3 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:09.530932 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d934abff-d64f-4a66-a6a4-0bf5e11548d3 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:09.532244 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d934abff-d64f-4a66-a6a4-0bf5e11548d3 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:09.532818 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d934abff-d64f-4a66-a6a4-0bf5e11548d3 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:09.678473 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-d934abff-d64f-4a66-a6a4-0bf5e11548d3 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:09.692286 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-d934abff-d64f-4a66-a6a4-0bf5e11548d3 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696" status: 200 len: 1265 microversion: 2.1 time: 0.180071 Aug 03 19:08:09.692872 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 197/388] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:09 2022] GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:08:10.713955 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-1fae8025-9219-43a6-b04b-f7533244c826 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:10.714673 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-1fae8025-9219-43a6-b04b-f7533244c826 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: 483630e6-3fee-46ff-8bd2-5031a27f8696] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:10.721357 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1fae8025-9219-43a6-b04b-f7533244c826 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:10.721806 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1fae8025-9219-43a6-b04b-f7533244c826 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:10.722583 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1fae8025-9219-43a6-b04b-f7533244c826 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:10.723066 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1fae8025-9219-43a6-b04b-f7533244c826 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:10.877528 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-1fae8025-9219-43a6-b04b-f7533244c826 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:10.885966 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-1fae8025-9219-43a6-b04b-f7533244c826 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696" status: 200 len: 1265 microversion: 2.1 time: 0.175866 Aug 03 19:08:10.886540 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 192/389] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:10 2022] GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:08:11.906862 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-3c5f4e19-dffb-4006-8c9d-b255f82f74d4 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:11.907502 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-3c5f4e19-dffb-4006-8c9d-b255f82f74d4 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: 483630e6-3fee-46ff-8bd2-5031a27f8696] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:11.916271 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3c5f4e19-dffb-4006-8c9d-b255f82f74d4 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:11.916827 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3c5f4e19-dffb-4006-8c9d-b255f82f74d4 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:11.917645 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3c5f4e19-dffb-4006-8c9d-b255f82f74d4 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:11.918146 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3c5f4e19-dffb-4006-8c9d-b255f82f74d4 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:12.072823 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-3c5f4e19-dffb-4006-8c9d-b255f82f74d4 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:12.080621 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-3c5f4e19-dffb-4006-8c9d-b255f82f74d4 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696" status: 200 len: 1265 microversion: 2.1 time: 0.177489 Aug 03 19:08:12.081107 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 198/390] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:11 2022] GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:08:13.114395 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-c839fb64-f692-4f13-9a8f-5b544789c551 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:13.115298 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-c839fb64-f692-4f13-9a8f-5b544789c551 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: 483630e6-3fee-46ff-8bd2-5031a27f8696] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:13.122377 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c839fb64-f692-4f13-9a8f-5b544789c551 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:13.122823 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c839fb64-f692-4f13-9a8f-5b544789c551 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:13.123619 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c839fb64-f692-4f13-9a8f-5b544789c551 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:13.124061 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c839fb64-f692-4f13-9a8f-5b544789c551 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:13.292139 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-c839fb64-f692-4f13-9a8f-5b544789c551 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:13.301221 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-c839fb64-f692-4f13-9a8f-5b544789c551 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696" status: 200 len: 1265 microversion: 2.1 time: 0.192565 Aug 03 19:08:13.301802 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 193/391] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:13 2022] GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:08:14.307969 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [req-aadfc180-7eb5-40b5-8092-d985582cb7a2 req-87799930-9eb5-4bd9-b999-fc13ed8994c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "483630e6-3fee-46ff-8bd2-5031a27f8696", "name": "network-vif-plugged", "status": "completed", "tag": "14e45674-2652-4efa-9368-ed9ccf397690"}]} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:08:14.319360 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-aadfc180-7eb5-40b5-8092-d985582cb7a2 req-87799930-9eb5-4bd9-b999-fc13ed8994c5 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:14.320063 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-aadfc180-7eb5-40b5-8092-d985582cb7a2 req-87799930-9eb5-4bd9-b999-fc13ed8994c5 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:14.323723 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-e4844800-6ce9-42cc-b726-3000635d0df3 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:14.324556 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-e4844800-6ce9-42cc-b726-3000635d0df3 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: 483630e6-3fee-46ff-8bd2-5031a27f8696] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:14.331058 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e4844800-6ce9-42cc-b726-3000635d0df3 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:14.331970 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e4844800-6ce9-42cc-b726-3000635d0df3 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:14.332962 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e4844800-6ce9-42cc-b726-3000635d0df3 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:14.333378 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.compute.server_external_events [req-aadfc180-7eb5-40b5-8092-d985582cb7a2 req-87799930-9eb5-4bd9-b999-fc13ed8994c5 service nova] Creating event network-vif-plugged:14e45674-2652-4efa-9368-ed9ccf397690 for instance 483630e6-3fee-46ff-8bd2-5031a27f8696 on hv-cinder-85202 Aug 03 19:08:14.333573 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e4844800-6ce9-42cc-b726-3000635d0df3 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:14.339083 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [req-aadfc180-7eb5-40b5-8092-d985582cb7a2 req-87799930-9eb5-4bd9-b999-fc13ed8994c5 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035443 Aug 03 19:08:14.340129 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 199/392] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:08:14.505011 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-e4844800-6ce9-42cc-b726-3000635d0df3 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:14.516352 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-e4844800-6ce9-42cc-b726-3000635d0df3 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696" status: 200 len: 1265 microversion: 2.1 time: 0.198270 Aug 03 19:08:14.516927 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 194/393] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:14 2022] GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696 => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:08:15.553798 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-cbcf19fa-dfba-48bb-b434-9cfc4551231b tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:15.554638 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-cbcf19fa-dfba-48bb-b434-9cfc4551231b tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: 483630e6-3fee-46ff-8bd2-5031a27f8696] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:15.561402 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cbcf19fa-dfba-48bb-b434-9cfc4551231b tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:15.561851 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cbcf19fa-dfba-48bb-b434-9cfc4551231b tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:15.562670 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cbcf19fa-dfba-48bb-b434-9cfc4551231b tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:15.563322 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cbcf19fa-dfba-48bb-b434-9cfc4551231b tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:15.707889 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-cbcf19fa-dfba-48bb-b434-9cfc4551231b tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:15.715739 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-cbcf19fa-dfba-48bb-b434-9cfc4551231b tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696" status: 200 len: 1265 microversion: 2.1 time: 0.170741 Aug 03 19:08:15.716302 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 200/394] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:15 2022] GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:08:16.737018 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-bd7cdcc1-e8c6-4a7d-ab52-2ae9e26902ab tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:16.737741 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-bd7cdcc1-e8c6-4a7d-ab52-2ae9e26902ab tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: 483630e6-3fee-46ff-8bd2-5031a27f8696] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:16.744643 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-bd7cdcc1-e8c6-4a7d-ab52-2ae9e26902ab tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:16.745097 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-bd7cdcc1-e8c6-4a7d-ab52-2ae9e26902ab tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:16.745905 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-bd7cdcc1-e8c6-4a7d-ab52-2ae9e26902ab tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:16.746340 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-bd7cdcc1-e8c6-4a7d-ab52-2ae9e26902ab tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:16.921071 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-bd7cdcc1-e8c6-4a7d-ab52-2ae9e26902ab tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:16.930663 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-bd7cdcc1-e8c6-4a7d-ab52-2ae9e26902ab tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696" status: 200 len: 1265 microversion: 2.1 time: 0.197623 Aug 03 19:08:16.931343 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 195/395] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:16 2022] GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696 => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:08:17.958379 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-c627485d-14b9-41ff-b425-6cf8586c44c9 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:17.959195 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-c627485d-14b9-41ff-b425-6cf8586c44c9 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: 483630e6-3fee-46ff-8bd2-5031a27f8696] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:17.966335 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c627485d-14b9-41ff-b425-6cf8586c44c9 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:17.974940 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c627485d-14b9-41ff-b425-6cf8586c44c9 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:17.974940 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c627485d-14b9-41ff-b425-6cf8586c44c9 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:17.974940 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c627485d-14b9-41ff-b425-6cf8586c44c9 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:18.073781 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-aecb314b-7235-4eeb-bc9f-d50486a68048 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e07f9567-999a-4ed1-9bf9-bb24bb2e81d5"}} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:08:18.076279 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-aecb314b-7235-4eeb-bc9f-d50486a68048 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:18.085671 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-aecb314b-7235-4eeb-bc9f-d50486a68048 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:18.087387 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-aecb314b-7235-4eeb-bc9f-d50486a68048 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:18.088190 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-aecb314b-7235-4eeb-bc9f-d50486a68048 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:18.088753 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-aecb314b-7235-4eeb-bc9f-d50486a68048 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:18.145422 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-c627485d-14b9-41ff-b425-6cf8586c44c9 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:18.157169 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-c627485d-14b9-41ff-b425-6cf8586c44c9 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696" status: 200 len: 1451 microversion: 2.1 time: 0.203167 Aug 03 19:08:18.157746 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 196/396] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:17 2022] GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696 => generated 1451 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:08:18.178764 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-0ff48a1c-f88d-41d2-a202-9086740f192f tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:18.179413 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-0ff48a1c-f88d-41d2-a202-9086740f192f tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: 483630e6-3fee-46ff-8bd2-5031a27f8696] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:18.188497 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0ff48a1c-f88d-41d2-a202-9086740f192f tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:18.189628 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0ff48a1c-f88d-41d2-a202-9086740f192f tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:18.189829 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0ff48a1c-f88d-41d2-a202-9086740f192f tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:18.190192 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0ff48a1c-f88d-41d2-a202-9086740f192f tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:18.350390 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-0ff48a1c-f88d-41d2-a202-9086740f192f tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:18.359318 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-0ff48a1c-f88d-41d2-a202-9086740f192f tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696" status: 200 len: 1451 microversion: 2.1 time: 0.184478 Aug 03 19:08:18.359967 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 197/397] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:18 2022] GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696 => generated 1451 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:08:19.081337 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-aecb314b-7235-4eeb-bc9f-d50486a68048 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "POST /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.223266 Aug 03 19:08:19.082464 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 201/398] 10.222.0.77 () {60 vars in 1323 bytes} [Wed Aug 3 19:08:17 2022] POST /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9/os-volume_attachments => generated 194 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:08:20.932140 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-ce3b82e9-aa91-4446-8080-71c87b67c066 req-b3bf10a1-f1b8-41c0-a33a-05dc8dcc4425 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "483630e6-3fee-46ff-8bd2-5031a27f8696", "tag": "14e45674-2652-4efa-9368-ed9ccf397690"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:08:20.937684 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:08:20.943143 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-ce3b82e9-aa91-4446-8080-71c87b67c066 req-b3bf10a1-f1b8-41c0-a33a-05dc8dcc4425 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:20.943591 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-ce3b82e9-aa91-4446-8080-71c87b67c066 req-b3bf10a1-f1b8-41c0-a33a-05dc8dcc4425 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:20.965465 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-ce3b82e9-aa91-4446-8080-71c87b67c066 req-b3bf10a1-f1b8-41c0-a33a-05dc8dcc4425 service nova] Creating event network-changed:14e45674-2652-4efa-9368-ed9ccf397690 for instance 483630e6-3fee-46ff-8bd2-5031a27f8696 on hv-cinder-85202 Aug 03 19:08:20.965465 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-ce3b82e9-aa91-4446-8080-71c87b67c066 req-b3bf10a1-f1b8-41c0-a33a-05dc8dcc4425 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031674 Aug 03 19:08:20.965465 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 198/399] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:08:27.715876 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-df969133-cf71-41f5-9ff9-ba705ab89574 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:08:27.718253 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-df969133-cf71-41f5-9ff9-ba705ab89574 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:27.720310 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_api:SELECT=42 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:08:27.728598 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-df969133-cf71-41f5-9ff9-ba705ab89574 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:27.729149 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-df969133-cf71-41f5-9ff9-ba705ab89574 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:27.730456 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-df969133-cf71-41f5-9ff9-ba705ab89574 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:27.730895 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-df969133-cf71-41f5-9ff9-ba705ab89574 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:27.756149 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.objects.instance [None req-df969133-cf71-41f5-9ff9-ba705ab89574 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lazy-loading 'flavor' on Instance uuid 87735baf-d677-4920-8453-c829a9e833b9 {{(pid=118303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:08:28.145563 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-df969133-cf71-41f5-9ff9-ba705ab89574 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "POST /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9/action" status: 200 len: 32 microversion: 2.1 time: 0.434834 Aug 03 19:08:28.146191 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 202/400] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 3 19:08:27 2022] POST /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9/action => generated 32 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 03 19:08:28.159626 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-f896e679-ab2f-4b37-9046-15c529c30f97 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:28.160666 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-f896e679-ab2f-4b37-9046-15c529c30f97 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:28.168959 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f896e679-ab2f-4b37-9046-15c529c30f97 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:28.169482 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f896e679-ab2f-4b37-9046-15c529c30f97 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:28.170336 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f896e679-ab2f-4b37-9046-15c529c30f97 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:28.170806 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f896e679-ab2f-4b37-9046-15c529c30f97 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:28.173941 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=99 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:08:28.341644 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-f896e679-ab2f-4b37-9046-15c529c30f97 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:28.356611 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-f896e679-ab2f-4b37-9046-15c529c30f97 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1734 microversion: 2.1 time: 0.201810 Aug 03 19:08:28.357667 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 199/401] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:28 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1734 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:08:29.390519 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-4908b49f-9f60-4046-a990-bc35f12a3955 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:29.391246 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-4908b49f-9f60-4046-a990-bc35f12a3955 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:29.397981 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4908b49f-9f60-4046-a990-bc35f12a3955 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:29.398970 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4908b49f-9f60-4046-a990-bc35f12a3955 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:29.399782 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4908b49f-9f60-4046-a990-bc35f12a3955 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:29.400222 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4908b49f-9f60-4046-a990-bc35f12a3955 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:29.562108 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-4908b49f-9f60-4046-a990-bc35f12a3955 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:29.574629 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-4908b49f-9f60-4046-a990-bc35f12a3955 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1734 microversion: 2.1 time: 0.188599 Aug 03 19:08:29.575668 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 203/402] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:29 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1734 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:08:30.598641 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-d8851854-59d6-4761-8c37-fa7f4aacff6b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:30.599224 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-d8851854-59d6-4761-8c37-fa7f4aacff6b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:30.606209 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d8851854-59d6-4761-8c37-fa7f4aacff6b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:30.606663 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d8851854-59d6-4761-8c37-fa7f4aacff6b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:30.607491 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d8851854-59d6-4761-8c37-fa7f4aacff6b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:30.607954 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d8851854-59d6-4761-8c37-fa7f4aacff6b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:30.745919 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-d8851854-59d6-4761-8c37-fa7f4aacff6b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:30.759536 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-d8851854-59d6-4761-8c37-fa7f4aacff6b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1734 microversion: 2.1 time: 0.165112 Aug 03 19:08:30.760115 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 200/403] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:30 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:08:31.783450 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-d4d6dd66-33da-4225-9a87-df1f3f469948 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:31.784093 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-d4d6dd66-33da-4225-9a87-df1f3f469948 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:31.791536 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d4d6dd66-33da-4225-9a87-df1f3f469948 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:31.791988 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d4d6dd66-33da-4225-9a87-df1f3f469948 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:31.792761 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d4d6dd66-33da-4225-9a87-df1f3f469948 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:31.793192 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d4d6dd66-33da-4225-9a87-df1f3f469948 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:31.796087 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:08:31.950928 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-d4d6dd66-33da-4225-9a87-df1f3f469948 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:31.959112 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-d4d6dd66-33da-4225-9a87-df1f3f469948 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1734 microversion: 2.1 time: 0.180838 Aug 03 19:08:31.959705 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 204/404] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:31 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1734 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:08:32.980435 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-c4dd5bc0-1419-4439-a360-2b39d1aa18d1 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:32.981065 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-c4dd5bc0-1419-4439-a360-2b39d1aa18d1 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:32.995493 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c4dd5bc0-1419-4439-a360-2b39d1aa18d1 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:32.995949 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c4dd5bc0-1419-4439-a360-2b39d1aa18d1 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:32.996731 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c4dd5bc0-1419-4439-a360-2b39d1aa18d1 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:32.997169 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c4dd5bc0-1419-4439-a360-2b39d1aa18d1 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:33.136133 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-c4dd5bc0-1419-4439-a360-2b39d1aa18d1 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:33.145252 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-c4dd5bc0-1419-4439-a360-2b39d1aa18d1 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1734 microversion: 2.1 time: 0.168675 Aug 03 19:08:33.145836 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 201/405] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:32 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:08:34.180984 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-f768e077-0988-4c6f-95d2-3911e69d9fdf tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:34.181652 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-f768e077-0988-4c6f-95d2-3911e69d9fdf tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:34.188856 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f768e077-0988-4c6f-95d2-3911e69d9fdf tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:34.189304 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f768e077-0988-4c6f-95d2-3911e69d9fdf tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:34.190081 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f768e077-0988-4c6f-95d2-3911e69d9fdf tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:34.190522 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f768e077-0988-4c6f-95d2-3911e69d9fdf tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:34.327659 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-f768e077-0988-4c6f-95d2-3911e69d9fdf tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:34.336983 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-f768e077-0988-4c6f-95d2-3911e69d9fdf tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1734 microversion: 2.1 time: 0.159988 Aug 03 19:08:34.337578 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 205/406] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:34 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:08:35.359025 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-933c27f5-5270-4610-a13e-36b4c4756928 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:35.359740 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-933c27f5-5270-4610-a13e-36b4c4756928 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:35.367599 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-933c27f5-5270-4610-a13e-36b4c4756928 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:35.368677 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-933c27f5-5270-4610-a13e-36b4c4756928 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:35.369462 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-933c27f5-5270-4610-a13e-36b4c4756928 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:35.370835 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-933c27f5-5270-4610-a13e-36b4c4756928 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:35.515601 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-933c27f5-5270-4610-a13e-36b4c4756928 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:35.524393 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-933c27f5-5270-4610-a13e-36b4c4756928 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1734 microversion: 2.1 time: 0.169704 Aug 03 19:08:35.524990 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 202/407] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:35 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:08:36.546613 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-e01ea99c-b588-4c63-a047-a33992ec67cf tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:36.547302 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-e01ea99c-b588-4c63-a047-a33992ec67cf tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:36.554138 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e01ea99c-b588-4c63-a047-a33992ec67cf tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:36.554596 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e01ea99c-b588-4c63-a047-a33992ec67cf tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:36.555444 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e01ea99c-b588-4c63-a047-a33992ec67cf tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:36.555916 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e01ea99c-b588-4c63-a047-a33992ec67cf tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:36.691569 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-e01ea99c-b588-4c63-a047-a33992ec67cf tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:36.700893 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-e01ea99c-b588-4c63-a047-a33992ec67cf tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1734 microversion: 2.1 time: 0.158354 Aug 03 19:08:36.701468 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 206/408] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:36 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:08:37.721806 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-f2157a5c-7f64-435c-9924-d9967faaae6d tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:37.722415 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-f2157a5c-7f64-435c-9924-d9967faaae6d tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:37.729607 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f2157a5c-7f64-435c-9924-d9967faaae6d tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:37.730057 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f2157a5c-7f64-435c-9924-d9967faaae6d tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:37.730841 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f2157a5c-7f64-435c-9924-d9967faaae6d tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:37.731298 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f2157a5c-7f64-435c-9924-d9967faaae6d tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:37.882719 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-f2157a5c-7f64-435c-9924-d9967faaae6d tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:37.892946 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-f2157a5c-7f64-435c-9924-d9967faaae6d tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1734 microversion: 2.1 time: 0.174880 Aug 03 19:08:37.906841 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 203/409] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:37 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:08:38.916130 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-145dc3cc-85dc-4c49-a238-c42c99a91302 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:38.916722 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-145dc3cc-85dc-4c49-a238-c42c99a91302 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:38.923606 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-145dc3cc-85dc-4c49-a238-c42c99a91302 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:38.924060 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-145dc3cc-85dc-4c49-a238-c42c99a91302 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:38.924851 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-145dc3cc-85dc-4c49-a238-c42c99a91302 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:38.925285 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-145dc3cc-85dc-4c49-a238-c42c99a91302 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:39.068910 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-145dc3cc-85dc-4c49-a238-c42c99a91302 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:39.078026 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-145dc3cc-85dc-4c49-a238-c42c99a91302 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1734 microversion: 2.1 time: 0.166052 Aug 03 19:08:39.078597 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 207/410] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:38 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:08:40.102857 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-1097c226-bffa-44e6-82e0-3bfdfcbfb405 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:40.103539 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-1097c226-bffa-44e6-82e0-3bfdfcbfb405 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:40.110486 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1097c226-bffa-44e6-82e0-3bfdfcbfb405 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:40.110933 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1097c226-bffa-44e6-82e0-3bfdfcbfb405 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:40.111750 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1097c226-bffa-44e6-82e0-3bfdfcbfb405 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:40.112186 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1097c226-bffa-44e6-82e0-3bfdfcbfb405 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:40.261564 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-1097c226-bffa-44e6-82e0-3bfdfcbfb405 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:40.275389 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-1097c226-bffa-44e6-82e0-3bfdfcbfb405 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1734 microversion: 2.1 time: 0.179650 Aug 03 19:08:40.275971 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 204/411] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:40 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1734 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:08:41.298330 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-9e412857-def0-4b0a-b59b-8d6887d7463a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:41.299096 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-9e412857-def0-4b0a-b59b-8d6887d7463a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:41.306496 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9e412857-def0-4b0a-b59b-8d6887d7463a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:41.306863 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9e412857-def0-4b0a-b59b-8d6887d7463a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:41.307711 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9e412857-def0-4b0a-b59b-8d6887d7463a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:41.308152 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9e412857-def0-4b0a-b59b-8d6887d7463a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:41.452468 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-9e412857-def0-4b0a-b59b-8d6887d7463a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:41.461848 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-9e412857-def0-4b0a-b59b-8d6887d7463a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1734 microversion: 2.1 time: 0.166986 Aug 03 19:08:41.463118 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 208/412] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:41 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:08:42.488127 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-51146036-888d-46cb-bc31-195e0040f96a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:42.488749 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-51146036-888d-46cb-bc31-195e0040f96a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:42.496546 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-51146036-888d-46cb-bc31-195e0040f96a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:42.496989 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-51146036-888d-46cb-bc31-195e0040f96a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:42.497894 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-51146036-888d-46cb-bc31-195e0040f96a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:42.498305 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-51146036-888d-46cb-bc31-195e0040f96a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:42.657927 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-51146036-888d-46cb-bc31-195e0040f96a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:42.668152 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-51146036-888d-46cb-bc31-195e0040f96a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1734 microversion: 2.1 time: 0.183770 Aug 03 19:08:42.668748 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 205/413] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:42 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1734 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:08:43.691249 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-e031c1dd-5b06-44f1-ab87-29fc5e52e118 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:43.691861 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-e031c1dd-5b06-44f1-ab87-29fc5e52e118 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:43.699914 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e031c1dd-5b06-44f1-ab87-29fc5e52e118 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:43.700364 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e031c1dd-5b06-44f1-ab87-29fc5e52e118 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:43.701132 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e031c1dd-5b06-44f1-ab87-29fc5e52e118 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:43.701563 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e031c1dd-5b06-44f1-ab87-29fc5e52e118 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:43.874598 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-e031c1dd-5b06-44f1-ab87-29fc5e52e118 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:43.883581 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-e031c1dd-5b06-44f1-ab87-29fc5e52e118 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1734 microversion: 2.1 time: 0.195845 Aug 03 19:08:43.884488 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 209/414] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:43 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1734 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:08:44.908340 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-9fdb2d27-616f-4e87-aa34-bd677b559fc4 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:44.908964 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-9fdb2d27-616f-4e87-aa34-bd677b559fc4 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:44.916219 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9fdb2d27-616f-4e87-aa34-bd677b559fc4 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:44.916695 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9fdb2d27-616f-4e87-aa34-bd677b559fc4 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:44.917474 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9fdb2d27-616f-4e87-aa34-bd677b559fc4 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:44.917910 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9fdb2d27-616f-4e87-aa34-bd677b559fc4 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:45.067367 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-9fdb2d27-616f-4e87-aa34-bd677b559fc4 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:45.076486 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-9fdb2d27-616f-4e87-aa34-bd677b559fc4 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1734 microversion: 2.1 time: 0.172256 Aug 03 19:08:45.077060 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 206/415] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:44 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:08:46.097819 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-8f8843b5-32bb-4e43-a0a1-351baead3d9c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:46.098703 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-8f8843b5-32bb-4e43-a0a1-351baead3d9c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:46.107343 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8f8843b5-32bb-4e43-a0a1-351baead3d9c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:46.107853 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8f8843b5-32bb-4e43-a0a1-351baead3d9c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:46.108703 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8f8843b5-32bb-4e43-a0a1-351baead3d9c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:46.109138 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8f8843b5-32bb-4e43-a0a1-351baead3d9c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:46.266413 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-8f8843b5-32bb-4e43-a0a1-351baead3d9c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:46.275817 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-8f8843b5-32bb-4e43-a0a1-351baead3d9c tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1734 microversion: 2.1 time: 0.181928 Aug 03 19:08:46.276394 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 210/416] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:46 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1734 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:08:47.297970 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-9d6c5937-9300-4f1f-b2af-f6a2d9fa1360 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:47.298603 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-9d6c5937-9300-4f1f-b2af-f6a2d9fa1360 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:47.305280 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9d6c5937-9300-4f1f-b2af-f6a2d9fa1360 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:47.306274 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9d6c5937-9300-4f1f-b2af-f6a2d9fa1360 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:47.307087 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9d6c5937-9300-4f1f-b2af-f6a2d9fa1360 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:47.307523 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9d6c5937-9300-4f1f-b2af-f6a2d9fa1360 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:47.447898 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-9d6c5937-9300-4f1f-b2af-f6a2d9fa1360 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:47.456100 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-9d6c5937-9300-4f1f-b2af-f6a2d9fa1360 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1734 microversion: 2.1 time: 0.162278 Aug 03 19:08:47.456658 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 207/417] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:47 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:08:47.611833 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-ca0c3022-f238-4480-bac9-481a39f1bc32 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:47.612353 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-ca0c3022-f238-4480-bac9-481a39f1bc32 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:47.618550 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ca0c3022-f238-4480-bac9-481a39f1bc32 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:47.619031 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ca0c3022-f238-4480-bac9-481a39f1bc32 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:47.619809 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ca0c3022-f238-4480-bac9-481a39f1bc32 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:47.620245 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ca0c3022-f238-4480-bac9-481a39f1bc32 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:47.757486 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.objects.instance [None req-ca0c3022-f238-4480-bac9-481a39f1bc32 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lazy-loading 'services' on Instance uuid cfa72c86-34b7-4dc4-b363-fed702f0cebd {{(pid=118303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:08:48.092571 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-ca0c3022-f238-4480-bac9-481a39f1bc32 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "DELETE /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd/os-volume_attachments/cf85f991-d269-453b-b500-d85a2ccec708" status: 202 len: 0 microversion: 2.1 time: 0.600979 Aug 03 19:08:48.093291 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 211/418] 10.222.0.77 () {58 vars in 1416 bytes} [Wed Aug 3 19:08:47 2022] DELETE /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd/os-volume_attachments/cf85f991-d269-453b-b500-d85a2ccec708 => generated 0 bytes in 603 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 19:08:48.478078 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-df3ed67f-ba82-40a1-b482-ad149e240b89 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:48.479270 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-df3ed67f-ba82-40a1-b482-ad149e240b89 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:48.486170 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-df3ed67f-ba82-40a1-b482-ad149e240b89 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:48.486627 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-df3ed67f-ba82-40a1-b482-ad149e240b89 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:48.487572 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-df3ed67f-ba82-40a1-b482-ad149e240b89 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:48.488016 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-df3ed67f-ba82-40a1-b482-ad149e240b89 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:48.657945 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-df3ed67f-ba82-40a1-b482-ad149e240b89 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:48.667358 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-df3ed67f-ba82-40a1-b482-ad149e240b89 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1734 microversion: 2.1 time: 0.193136 Aug 03 19:08:48.668324 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 208/419] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:48 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1734 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:08:49.697245 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-3f8eb2bf-b1bf-4d14-9722-60f6617fd464 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:49.697843 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-3f8eb2bf-b1bf-4d14-9722-60f6617fd464 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:49.710600 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3f8eb2bf-b1bf-4d14-9722-60f6617fd464 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:49.711484 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3f8eb2bf-b1bf-4d14-9722-60f6617fd464 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:49.712795 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3f8eb2bf-b1bf-4d14-9722-60f6617fd464 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:49.713423 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3f8eb2bf-b1bf-4d14-9722-60f6617fd464 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:49.869796 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-3f8eb2bf-b1bf-4d14-9722-60f6617fd464 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:49.878294 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-3f8eb2bf-b1bf-4d14-9722-60f6617fd464 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1714 microversion: 2.1 time: 0.186491 Aug 03 19:08:49.878880 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 212/420] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:49 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1714 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:08:49.951038 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-216e01d1-c928-4cd5-9caf-8e6481d84bfa tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:49.951640 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-216e01d1-c928-4cd5-9caf-8e6481d84bfa tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:49.960413 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-216e01d1-c928-4cd5-9caf-8e6481d84bfa tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:49.960856 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-216e01d1-c928-4cd5-9caf-8e6481d84bfa tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:49.962710 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-216e01d1-c928-4cd5-9caf-8e6481d84bfa tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:49.963083 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-216e01d1-c928-4cd5-9caf-8e6481d84bfa tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:50.092629 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.wsgi [None req-216e01d1-c928-4cd5-9caf-8e6481d84bfa tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] HTTP exception thrown: Cannot 'detach_volume' instance 87735baf-d677-4920-8453-c829a9e833b9 while it is in vm_state rescued Aug 03 19:08:50.094261 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-216e01d1-c928-4cd5-9caf-8e6481d84bfa tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Request method failure captured: Aug 03 19:08:50.094261 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: request: DELETE /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9/os-volume_attachments/e07f9567-999a-4ed1-9bf9-bb24bb2e81d5 HTTP/1.1 Aug 03 19:08:50.094261 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept: application/json Aug 03 19:08:50.094261 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept-Encoding: identity Aug 03 19:08:50.094261 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Connection: close Aug 03 19:08:50.094261 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Length: 0 Aug 03 19:08:50.094261 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Type: application/json Aug 03 19:08:50.094261 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Host: 10.222.0.77 Aug 03 19:08:50.094261 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Openstack-System-Scope: None Aug 03 19:08:50.094261 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: User-Agent: python-urllib3/1.26.11 Aug 03 19:08:50.094261 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Auth-Token: gAAAAABi6sZpW7w7YQZ3ICnejTi_VA0idBlfsSFO1OcVhcF8hcGMcBJoz1L9T5T64xxPIqj2mDSnq3haUv8vF_XUJoqHhvqS8KjotAxSwLqgNhIXH7oXp4pMLcBvPDn6dBXb26JYx8SgQOYpnZ_y7iEMNLg6DSgl3Ss3QzdBRQ8W6OiIonlfjz4 Aug 03 19:08:50.094261 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Id: None Aug 03 19:08:50.094261 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Name: None Aug 03 19:08:50.094261 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Identity-Status: Confirmed Aug 03 19:08:50.094261 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Is-Admin-Project: True Aug 03 19:08:50.094261 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Id: default Aug 03 19:08:50.094261 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Name: Default Aug 03 19:08:50.094261 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Id: bf009469f935465baa6427ab4951944e Aug 03 19:08:50.094261 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1404930254 Aug 03 19:08:50.094261 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Role: reader,member Aug 03 19:08:50.094261 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Roles: reader,member Aug 03 19:08:50.096288 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_bf009469f935465baa6427ab4951944e", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/bf009469f935465baa6427ab4951944e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/bf009469f935465baa6427ab4951944e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/bf009469f935465baa6427ab4951944e"}]}] Aug 03 19:08:50.096288 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1404930254 Aug 03 19:08:50.096288 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Id: bf009469f935465baa6427ab4951944e Aug 03 19:08:50.096288 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1404930254 Aug 03 19:08:50.096288 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User: tempest-ServerRescueNegativeTestJSON-1404930254-project Aug 03 19:08:50.096288 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Id: default Aug 03 19:08:50.096288 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Name: Default Aug 03 19:08:50.096288 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Id: 9c46900844e8483bb2dff3b9e65df372 Aug 03 19:08:50.096288 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1404930254-project Aug 03 19:08:50.096288 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: method: > Aug 03 19:08:50.096288 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: exception: Cannot 'detach_volume' instance 87735baf-d677-4920-8453-c829a9e833b9 while it is in vm_state rescued Aug 03 19:08:50.097111 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: action_args: {'server_id': '87735baf-d677-4920-8453-c829a9e833b9', 'id': 'e07f9567-999a-4ed1-9bf9-bb24bb2e81d5'} Aug 03 19:08:50.097111 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:08:50.097111 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:08:50.097111 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 03 19:08:50.097111 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 03 19:08:50.097111 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 19:08:50.097111 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 19:08:50.097111 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 03 19:08:50.097111 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 19:08:50.097111 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 87735baf-d677-4920-8453-c829a9e833b9 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 03 19:08:50.097111 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:08:50.097111 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:08:50.097111 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:08:50.097111 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:08:50.097111 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:08:50.097111 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:08:50.097111 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:08:50.097111 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:08:50.097111 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:08:50.097111 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:08:50.098444 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 03 19:08:50.098444 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 03 19:08:50.098444 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 19:08:50.098444 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 19:08:50.098444 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 87735baf-d677-4920-8453-c829a9e833b9 while it is in vm_state rescued Aug 03 19:08:50.098444 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:08:50.098444 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:08:50.098444 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:08:50.098444 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:08:50.098444 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:08:50.098444 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:08:50.098444 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:08:50.098444 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:08:50.098444 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 87735baf-d677-4920-8453-c829a9e833b9 while it is in vm_state rescued Aug 03 19:08:50.098444 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:08:50.098444 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-216e01d1-c928-4cd5-9caf-8e6481d84bfa tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Returning 409 to user: Cannot 'detach_volume' instance 87735baf-d677-4920-8453-c829a9e833b9 while it is in vm_state rescued {{(pid=118302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:08:50.099595 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-216e01d1-c928-4cd5-9caf-8e6481d84bfa tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "DELETE /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9/os-volume_attachments/e07f9567-999a-4ed1-9bf9-bb24bb2e81d5" status: 409 len: 152 microversion: 2.1 time: 0.149274 Aug 03 19:08:50.099595 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 209/421] 10.222.0.77 () {58 vars in 1416 bytes} [Wed Aug 3 19:08:49 2022] DELETE /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9/os-volume_attachments/e07f9567-999a-4ed1-9bf9-bb24bb2e81d5 => generated 152 bytes in 150 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 19:08:50.106093 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-fa56075e-0e2d-4144-a255-099c84aa0519 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:08:50.106755 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-fa56075e-0e2d-4144-a255-099c84aa0519 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:50.113141 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fa56075e-0e2d-4144-a255-099c84aa0519 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:50.113658 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fa56075e-0e2d-4144-a255-099c84aa0519 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:50.114927 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fa56075e-0e2d-4144-a255-099c84aa0519 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:50.114927 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fa56075e-0e2d-4144-a255-099c84aa0519 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:50.289892 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-9b351a25-5f72-41d3-a496-5f09a575a98e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:08:50.297115 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9b351a25-5f72-41d3-a496-5f09a575a98e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:50.297570 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9b351a25-5f72-41d3-a496-5f09a575a98e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:50.322710 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-9b351a25-5f72-41d3-a496-5f09a575a98e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Going to try to stop instance {{(pid=118302) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 03 19:08:50.369849 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-fa56075e-0e2d-4144-a255-099c84aa0519 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "POST /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9/action" status: 202 len: 0 microversion: 2.1 time: 0.268256 Aug 03 19:08:50.370489 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 213/422] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 3 19:08:50 2022] POST /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 19:08:50.379661 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-4fe763e1-60f9-41c8-8aa7-dd72c911b63b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:50.380483 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-4fe763e1-60f9-41c8-8aa7-dd72c911b63b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:50.387727 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4fe763e1-60f9-41c8-8aa7-dd72c911b63b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:50.388179 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4fe763e1-60f9-41c8-8aa7-dd72c911b63b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:50.388955 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4fe763e1-60f9-41c8-8aa7-dd72c911b63b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:50.389394 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4fe763e1-60f9-41c8-8aa7-dd72c911b63b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:50.530002 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-4fe763e1-60f9-41c8-8aa7-dd72c911b63b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:50.538376 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-4fe763e1-60f9-41c8-8aa7-dd72c911b63b tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1722 microversion: 2.1 time: 0.163098 Aug 03 19:08:50.539509 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 214/423] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:50 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:08:50.621327 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-9b351a25-5f72-41d3-a496-5f09a575a98e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "POST /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd/action" status: 202 len: 0 microversion: 2.1 time: 0.335319 Aug 03 19:08:50.621974 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 210/424] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 3 19:08:50 2022] POST /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 19:08:50.630765 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-636aeb31-ddc9-40ac-93a3-bc225422d19e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:50.636014 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-636aeb31-ddc9-40ac-93a3-bc225422d19e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:50.639697 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-636aeb31-ddc9-40ac-93a3-bc225422d19e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:50.640177 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-636aeb31-ddc9-40ac-93a3-bc225422d19e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:50.641005 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-636aeb31-ddc9-40ac-93a3-bc225422d19e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:50.641448 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-636aeb31-ddc9-40ac-93a3-bc225422d19e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:50.793066 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-636aeb31-ddc9-40ac-93a3-bc225422d19e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:50.801071 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-636aeb31-ddc9-40ac-93a3-bc225422d19e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1677 microversion: 2.1 time: 0.174600 Aug 03 19:08:50.808103 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 215/425] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:50 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:08:51.561444 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-83a38356-1948-4854-b548-b04a95eb0203 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:51.562079 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-83a38356-1948-4854-b548-b04a95eb0203 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:51.569340 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-83a38356-1948-4854-b548-b04a95eb0203 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:51.569684 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-83a38356-1948-4854-b548-b04a95eb0203 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:51.571389 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-83a38356-1948-4854-b548-b04a95eb0203 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:51.571837 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-83a38356-1948-4854-b548-b04a95eb0203 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:51.719036 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-83a38356-1948-4854-b548-b04a95eb0203 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:51.727978 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-83a38356-1948-4854-b548-b04a95eb0203 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1722 microversion: 2.1 time: 0.170816 Aug 03 19:08:51.728566 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 211/426] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:51 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:08:51.823673 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-ae4e319d-711b-4554-901b-294694c9aa62 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:51.824200 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-ae4e319d-711b-4554-901b-294694c9aa62 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:51.830800 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ae4e319d-711b-4554-901b-294694c9aa62 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:51.831286 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ae4e319d-711b-4554-901b-294694c9aa62 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:51.832056 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ae4e319d-711b-4554-901b-294694c9aa62 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:51.832484 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ae4e319d-711b-4554-901b-294694c9aa62 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:51.986882 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-ae4e319d-711b-4554-901b-294694c9aa62 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:51.995752 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-ae4e319d-711b-4554-901b-294694c9aa62 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1677 microversion: 2.1 time: 0.176149 Aug 03 19:08:51.996335 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 216/427] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:51 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1677 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:08:52.749465 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-9028e860-28af-4b47-8d8b-693a10ec3f0d tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:52.750069 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-9028e860-28af-4b47-8d8b-693a10ec3f0d tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:52.756797 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9028e860-28af-4b47-8d8b-693a10ec3f0d tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:52.757240 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9028e860-28af-4b47-8d8b-693a10ec3f0d tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:52.758703 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9028e860-28af-4b47-8d8b-693a10ec3f0d tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:52.759531 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9028e860-28af-4b47-8d8b-693a10ec3f0d tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:52.901800 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-9028e860-28af-4b47-8d8b-693a10ec3f0d tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:52.910018 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-9028e860-28af-4b47-8d8b-693a10ec3f0d tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1722 microversion: 2.1 time: 0.164348 Aug 03 19:08:52.910585 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 212/428] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:52 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:08:53.018329 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-5ed0a904-9b70-41d2-a90f-5ed76cdf59e1 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:53.018928 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-5ed0a904-9b70-41d2-a90f-5ed76cdf59e1 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:53.026491 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5ed0a904-9b70-41d2-a90f-5ed76cdf59e1 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:53.026972 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5ed0a904-9b70-41d2-a90f-5ed76cdf59e1 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:53.027752 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5ed0a904-9b70-41d2-a90f-5ed76cdf59e1 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:53.028191 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5ed0a904-9b70-41d2-a90f-5ed76cdf59e1 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:53.173285 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-5ed0a904-9b70-41d2-a90f-5ed76cdf59e1 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:53.182034 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-5ed0a904-9b70-41d2-a90f-5ed76cdf59e1 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1677 microversion: 2.1 time: 0.167746 Aug 03 19:08:53.182836 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 217/429] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:53 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:08:53.932402 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-70443a21-8e27-43b0-90a7-36fb8e1b4aff tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:53.932950 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-70443a21-8e27-43b0-90a7-36fb8e1b4aff tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:53.939461 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-70443a21-8e27-43b0-90a7-36fb8e1b4aff tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:53.939946 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-70443a21-8e27-43b0-90a7-36fb8e1b4aff tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:53.940713 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-70443a21-8e27-43b0-90a7-36fb8e1b4aff tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:53.941145 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-70443a21-8e27-43b0-90a7-36fb8e1b4aff tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:54.085518 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-70443a21-8e27-43b0-90a7-36fb8e1b4aff tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:54.094298 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-70443a21-8e27-43b0-90a7-36fb8e1b4aff tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1722 microversion: 2.1 time: 0.165822 Aug 03 19:08:54.094849 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 213/430] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:53 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:08:54.203827 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-6f994d1f-b01b-4608-ab37-ec289dd57d6a tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:54.204389 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-6f994d1f-b01b-4608-ab37-ec289dd57d6a tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:54.211056 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6f994d1f-b01b-4608-ab37-ec289dd57d6a tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:54.211545 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6f994d1f-b01b-4608-ab37-ec289dd57d6a tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:54.212293 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6f994d1f-b01b-4608-ab37-ec289dd57d6a tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:54.212730 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6f994d1f-b01b-4608-ab37-ec289dd57d6a tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:54.350825 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-6f994d1f-b01b-4608-ab37-ec289dd57d6a tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:54.359554 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-6f994d1f-b01b-4608-ab37-ec289dd57d6a tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1677 microversion: 2.1 time: 0.159678 Aug 03 19:08:54.360464 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 218/431] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:54 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:08:55.115098 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-c4ab316e-c4d4-464c-96c1-3632ebcdd13a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:55.115982 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-c4ab316e-c4d4-464c-96c1-3632ebcdd13a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:55.123276 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c4ab316e-c4d4-464c-96c1-3632ebcdd13a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:55.123784 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c4ab316e-c4d4-464c-96c1-3632ebcdd13a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:55.124493 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c4ab316e-c4d4-464c-96c1-3632ebcdd13a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:55.124927 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c4ab316e-c4d4-464c-96c1-3632ebcdd13a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:55.270122 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-c4ab316e-c4d4-464c-96c1-3632ebcdd13a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:55.272547 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:08:55.286351 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-c4ab316e-c4d4-464c-96c1-3632ebcdd13a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1728 microversion: 2.1 time: 0.174837 Aug 03 19:08:55.289825 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 214/432] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:55 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:08:55.308255 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-76ee980e-b08b-49a0-b440-9062101518d6 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:55.308843 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-76ee980e-b08b-49a0-b440-9062101518d6 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:55.315637 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-76ee980e-b08b-49a0-b440-9062101518d6 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:55.318516 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-76ee980e-b08b-49a0-b440-9062101518d6 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:55.318516 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-76ee980e-b08b-49a0-b440-9062101518d6 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:55.318516 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-76ee980e-b08b-49a0-b440-9062101518d6 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:55.319976 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:08:55.382451 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-d304e12c-3f3f-4526-a7e8-06a4cae9b1a2 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:55.383704 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-d304e12c-3f3f-4526-a7e8-06a4cae9b1a2 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:55.390606 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d304e12c-3f3f-4526-a7e8-06a4cae9b1a2 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:55.391094 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d304e12c-3f3f-4526-a7e8-06a4cae9b1a2 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:55.391879 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d304e12c-3f3f-4526-a7e8-06a4cae9b1a2 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:55.392607 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d304e12c-3f3f-4526-a7e8-06a4cae9b1a2 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:55.405983 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-76ee980e-b08b-49a0-b440-9062101518d6 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101929 Aug 03 19:08:55.406713 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 219/433] 10.222.0.77 () {58 vars in 1275 bytes} [Wed Aug 3 19:08:55 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:08:55.557555 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-d304e12c-3f3f-4526-a7e8-06a4cae9b1a2 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:55.566155 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-d304e12c-3f3f-4526-a7e8-06a4cae9b1a2 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1677 microversion: 2.1 time: 0.188160 Aug 03 19:08:55.566974 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 215/434] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:55 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1677 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:08:56.531405 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [req-c7a00908-0ea0-4188-bb96-b0e4a044fbca req-066feb30-817f-44d7-b662-141d73ab97fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87735baf-d677-4920-8453-c829a9e833b9", "tag": "013884d5-b737-4e4b-8a8f-00c6a8b5fbe3"}]} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:08:56.542511 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-c7a00908-0ea0-4188-bb96-b0e4a044fbca req-066feb30-817f-44d7-b662-141d73ab97fd service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:56.545634 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-c7a00908-0ea0-4188-bb96-b0e4a044fbca req-066feb30-817f-44d7-b662-141d73ab97fd service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:56.557306 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.compute.server_external_events [req-c7a00908-0ea0-4188-bb96-b0e4a044fbca req-066feb30-817f-44d7-b662-141d73ab97fd service nova] Creating event network-changed:013884d5-b737-4e4b-8a8f-00c6a8b5fbe3 for instance 87735baf-d677-4920-8453-c829a9e833b9 on hv-cinder-85202 Aug 03 19:08:56.562699 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [req-c7a00908-0ea0-4188-bb96-b0e4a044fbca req-066feb30-817f-44d7-b662-141d73ab97fd service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105292 Aug 03 19:08:56.563500 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 220/435] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 19:08:56.588603 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-06b201b4-c3b1-4292-b8ca-abfe1199cb9f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:56.589454 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-06b201b4-c3b1-4292-b8ca-abfe1199cb9f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:56.596119 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-06b201b4-c3b1-4292-b8ca-abfe1199cb9f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:56.597239 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-06b201b4-c3b1-4292-b8ca-abfe1199cb9f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:56.602178 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-06b201b4-c3b1-4292-b8ca-abfe1199cb9f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:56.602738 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-06b201b4-c3b1-4292-b8ca-abfe1199cb9f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:56.854416 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-06b201b4-c3b1-4292-b8ca-abfe1199cb9f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:56.862202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-06b201b4-c3b1-4292-b8ca-abfe1199cb9f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1677 microversion: 2.1 time: 0.278548 Aug 03 19:08:56.862777 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 216/436] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:56 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1677 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:08:57.888289 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-c65a41a9-8bae-4150-ab6f-9489cab2b8f5 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:57.889048 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-c65a41a9-8bae-4150-ab6f-9489cab2b8f5 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:57.891059 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_api:SELECT=38 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:08:57.896079 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c65a41a9-8bae-4150-ab6f-9489cab2b8f5 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:57.896529 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c65a41a9-8bae-4150-ab6f-9489cab2b8f5 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:57.897308 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c65a41a9-8bae-4150-ab6f-9489cab2b8f5 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:57.897744 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c65a41a9-8bae-4150-ab6f-9489cab2b8f5 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:58.047507 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-c65a41a9-8bae-4150-ab6f-9489cab2b8f5 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:58.055961 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-c65a41a9-8bae-4150-ab6f-9489cab2b8f5 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1677 microversion: 2.1 time: 0.173675 Aug 03 19:08:58.056529 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 221/437] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:57 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:08:58.578712 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-9b16a7f6-a5b3-4b37-890c-e0c26166e140 req-3f3b627b-5a21-487d-bafb-ccd19588d3fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87735baf-d677-4920-8453-c829a9e833b9", "tag": "013884d5-b737-4e4b-8a8f-00c6a8b5fbe3"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:08:58.584284 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_api:SELECT=38 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:08:58.589879 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-9b16a7f6-a5b3-4b37-890c-e0c26166e140 req-3f3b627b-5a21-487d-bafb-ccd19588d3fd service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:58.590342 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-9b16a7f6-a5b3-4b37-890c-e0c26166e140 req-3f3b627b-5a21-487d-bafb-ccd19588d3fd service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:58.602811 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-9b16a7f6-a5b3-4b37-890c-e0c26166e140 req-3f3b627b-5a21-487d-bafb-ccd19588d3fd service nova] Creating event network-changed:013884d5-b737-4e4b-8a8f-00c6a8b5fbe3 for instance 87735baf-d677-4920-8453-c829a9e833b9 on hv-cinder-85202 Aug 03 19:08:58.608200 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-9b16a7f6-a5b3-4b37-890c-e0c26166e140 req-3f3b627b-5a21-487d-bafb-ccd19588d3fd service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033298 Aug 03 19:08:58.608912 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 217/438] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:08:59.077653 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-5e5a219d-49d3-4988-8c59-4a003fdfa6b1 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:08:59.078269 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-5e5a219d-49d3-4988-8c59-4a003fdfa6b1 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:08:59.085152 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5e5a219d-49d3-4988-8c59-4a003fdfa6b1 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:59.085601 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5e5a219d-49d3-4988-8c59-4a003fdfa6b1 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:59.087267 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5e5a219d-49d3-4988-8c59-4a003fdfa6b1 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:08:59.087708 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5e5a219d-49d3-4988-8c59-4a003fdfa6b1 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:08:59.278183 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-5e5a219d-49d3-4988-8c59-4a003fdfa6b1 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:08:59.289003 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-5e5a219d-49d3-4988-8c59-4a003fdfa6b1 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1677 microversion: 2.1 time: 0.215227 Aug 03 19:08:59.290570 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 222/439] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:08:59 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1677 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:09:00.332813 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-4d2c6b7d-3063-45ce-bb67-f1dde8d4383a tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:00.333516 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-4d2c6b7d-3063-45ce-bb67-f1dde8d4383a tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:09:00.340662 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4d2c6b7d-3063-45ce-bb67-f1dde8d4383a tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:00.341120 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4d2c6b7d-3063-45ce-bb67-f1dde8d4383a tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:00.341885 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4d2c6b7d-3063-45ce-bb67-f1dde8d4383a tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:00.342322 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4d2c6b7d-3063-45ce-bb67-f1dde8d4383a tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:00.475107 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-4d2c6b7d-3063-45ce-bb67-f1dde8d4383a tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:09:00.488971 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-4d2c6b7d-3063-45ce-bb67-f1dde8d4383a tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1677 microversion: 2.1 time: 0.161089 Aug 03 19:09:00.489953 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 218/440] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:09:00 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:09:01.510300 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-91ef7880-1888-44d2-a83c-8e80e8c10411 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:01.510873 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-91ef7880-1888-44d2-a83c-8e80e8c10411 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:09:01.517817 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-91ef7880-1888-44d2-a83c-8e80e8c10411 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:01.518264 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-91ef7880-1888-44d2-a83c-8e80e8c10411 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:01.519059 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-91ef7880-1888-44d2-a83c-8e80e8c10411 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:01.519500 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-91ef7880-1888-44d2-a83c-8e80e8c10411 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:01.882020 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-91ef7880-1888-44d2-a83c-8e80e8c10411 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:09:01.890313 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-91ef7880-1888-44d2-a83c-8e80e8c10411 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1677 microversion: 2.1 time: 0.383950 Aug 03 19:09:01.890883 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 223/441] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:09:01 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1677 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:09:02.912627 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-70f21993-32c2-4efe-abe4-094ac2c6d96d tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:02.913298 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-70f21993-32c2-4efe-abe4-094ac2c6d96d tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:09:02.921166 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-70f21993-32c2-4efe-abe4-094ac2c6d96d tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:02.925143 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-70f21993-32c2-4efe-abe4-094ac2c6d96d tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:02.925143 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-70f21993-32c2-4efe-abe4-094ac2c6d96d tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:02.925143 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-70f21993-32c2-4efe-abe4-094ac2c6d96d tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:03.060889 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-70f21993-32c2-4efe-abe4-094ac2c6d96d tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:09:03.069682 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-70f21993-32c2-4efe-abe4-094ac2c6d96d tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1677 microversion: 2.1 time: 0.161221 Aug 03 19:09:03.070345 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 219/442] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:09:02 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:09:04.091745 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-8fcd7a50-cfdd-41fc-ba0b-76487583cc68 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:04.092777 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-8fcd7a50-cfdd-41fc-ba0b-76487583cc68 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:09:04.099317 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8fcd7a50-cfdd-41fc-ba0b-76487583cc68 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:04.099774 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8fcd7a50-cfdd-41fc-ba0b-76487583cc68 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:04.100574 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8fcd7a50-cfdd-41fc-ba0b-76487583cc68 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:04.101094 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8fcd7a50-cfdd-41fc-ba0b-76487583cc68 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:04.248834 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-8fcd7a50-cfdd-41fc-ba0b-76487583cc68 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:09:04.257340 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-8fcd7a50-cfdd-41fc-ba0b-76487583cc68 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1677 microversion: 2.1 time: 0.169726 Aug 03 19:09:04.258117 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 224/443] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:09:04 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:09:05.278090 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-829494cb-23bb-4cd4-bc7d-b704a0b45ba9 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:05.278720 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-829494cb-23bb-4cd4-bc7d-b704a0b45ba9 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:09:05.285582 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-829494cb-23bb-4cd4-bc7d-b704a0b45ba9 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:05.286323 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-829494cb-23bb-4cd4-bc7d-b704a0b45ba9 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:05.287249 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-829494cb-23bb-4cd4-bc7d-b704a0b45ba9 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:05.287713 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-829494cb-23bb-4cd4-bc7d-b704a0b45ba9 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:05.434247 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-829494cb-23bb-4cd4-bc7d-b704a0b45ba9 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:09:05.442033 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-829494cb-23bb-4cd4-bc7d-b704a0b45ba9 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1677 microversion: 2.1 time: 0.168172 Aug 03 19:09:05.442601 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 220/444] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:09:05 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:09:06.464137 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-c9b5e8e0-6645-4b9b-aa0d-03d944e24c56 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:06.464750 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-c9b5e8e0-6645-4b9b-aa0d-03d944e24c56 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:09:06.471563 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c9b5e8e0-6645-4b9b-aa0d-03d944e24c56 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:06.472304 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c9b5e8e0-6645-4b9b-aa0d-03d944e24c56 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:06.472844 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c9b5e8e0-6645-4b9b-aa0d-03d944e24c56 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:06.473344 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c9b5e8e0-6645-4b9b-aa0d-03d944e24c56 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:06.612081 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-c9b5e8e0-6645-4b9b-aa0d-03d944e24c56 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:09:06.620482 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-c9b5e8e0-6645-4b9b-aa0d-03d944e24c56 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1677 microversion: 2.1 time: 0.161156 Aug 03 19:09:06.621293 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 225/445] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:09:06 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:09:07.644901 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-9be6024e-3a43-4d49-929d-4137854ac42e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:07.645773 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-9be6024e-3a43-4d49-929d-4137854ac42e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:09:07.654816 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9be6024e-3a43-4d49-929d-4137854ac42e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:07.655421 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9be6024e-3a43-4d49-929d-4137854ac42e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:07.656701 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9be6024e-3a43-4d49-929d-4137854ac42e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:07.657416 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9be6024e-3a43-4d49-929d-4137854ac42e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:07.822274 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-9be6024e-3a43-4d49-929d-4137854ac42e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:09:07.832748 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-9be6024e-3a43-4d49-929d-4137854ac42e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1677 microversion: 2.1 time: 0.194506 Aug 03 19:09:07.833321 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 221/446] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:09:07 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1677 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:09:08.858721 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-e5bd0d4d-7842-4292-a930-bf26dcb3e8ef tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:08.859391 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-e5bd0d4d-7842-4292-a930-bf26dcb3e8ef tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:09:08.865979 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e5bd0d4d-7842-4292-a930-bf26dcb3e8ef tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:08.866426 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e5bd0d4d-7842-4292-a930-bf26dcb3e8ef tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:08.867266 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e5bd0d4d-7842-4292-a930-bf26dcb3e8ef tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:08.867898 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e5bd0d4d-7842-4292-a930-bf26dcb3e8ef tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:09.010016 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-e5bd0d4d-7842-4292-a930-bf26dcb3e8ef tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:09:09.017535 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-e5bd0d4d-7842-4292-a930-bf26dcb3e8ef tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1677 microversion: 2.1 time: 0.166288 Aug 03 19:09:09.019230 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 226/447] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:09:08 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:09:10.040213 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-ceff7c6f-7e01-4bf9-aca3-9b90a04032f9 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:10.040901 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-ceff7c6f-7e01-4bf9-aca3-9b90a04032f9 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:09:10.047518 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ceff7c6f-7e01-4bf9-aca3-9b90a04032f9 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:10.047962 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ceff7c6f-7e01-4bf9-aca3-9b90a04032f9 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:10.048799 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ceff7c6f-7e01-4bf9-aca3-9b90a04032f9 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:10.049227 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ceff7c6f-7e01-4bf9-aca3-9b90a04032f9 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:10.188066 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-ceff7c6f-7e01-4bf9-aca3-9b90a04032f9 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:09:10.195865 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-ceff7c6f-7e01-4bf9-aca3-9b90a04032f9 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1677 microversion: 2.1 time: 0.160355 Aug 03 19:09:10.196524 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 222/448] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:09:10 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:09:11.219379 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-826c371c-7979-4f33-8bdb-003951d12d00 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:11.260403 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-826c371c-7979-4f33-8bdb-003951d12d00 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:09:11.260403 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-826c371c-7979-4f33-8bdb-003951d12d00 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:11.260403 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-826c371c-7979-4f33-8bdb-003951d12d00 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:11.260403 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-826c371c-7979-4f33-8bdb-003951d12d00 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:11.261440 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-826c371c-7979-4f33-8bdb-003951d12d00 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:11.381988 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-826c371c-7979-4f33-8bdb-003951d12d00 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:09:11.393243 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-826c371c-7979-4f33-8bdb-003951d12d00 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1677 microversion: 2.1 time: 0.178479 Aug 03 19:09:11.394053 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 227/449] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:09:11 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:09:12.414324 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-79561f57-e06f-4bf3-b290-9b117774cd7e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:12.414988 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-79561f57-e06f-4bf3-b290-9b117774cd7e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:09:12.422172 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-79561f57-e06f-4bf3-b290-9b117774cd7e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:12.422703 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-79561f57-e06f-4bf3-b290-9b117774cd7e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:12.423430 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-79561f57-e06f-4bf3-b290-9b117774cd7e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:12.423864 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-79561f57-e06f-4bf3-b290-9b117774cd7e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:12.579875 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-79561f57-e06f-4bf3-b290-9b117774cd7e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:09:12.587575 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-79561f57-e06f-4bf3-b290-9b117774cd7e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1654 microversion: 2.1 time: 0.177291 Aug 03 19:09:12.588139 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 223/450] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:09:12 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1654 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:09:12.607966 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-c0436924-5084-4d98-b311-9802b6f472be tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:09:12.614977 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c0436924-5084-4d98-b311-9802b6f472be tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:12.615425 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c0436924-5084-4d98-b311-9802b6f472be tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:12.679133 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-c0436924-5084-4d98-b311-9802b6f472be tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Going to try to start instance {{(pid=118303) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 03 19:09:12.894813 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-c0436924-5084-4d98-b311-9802b6f472be tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "POST /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd/action" status: 202 len: 0 microversion: 2.1 time: 0.290473 Aug 03 19:09:12.895377 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 228/451] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 3 19:09:12 2022] POST /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 19:09:12.903995 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-fb0063c8-8548-407b-89b6-e42b615300c6 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:12.904607 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-fb0063c8-8548-407b-89b6-e42b615300c6 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:09:12.911397 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fb0063c8-8548-407b-89b6-e42b615300c6 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:12.911879 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fb0063c8-8548-407b-89b6-e42b615300c6 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:12.912701 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fb0063c8-8548-407b-89b6-e42b615300c6 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:12.913144 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fb0063c8-8548-407b-89b6-e42b615300c6 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:13.069285 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-fb0063c8-8548-407b-89b6-e42b615300c6 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:09:13.080842 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-fb0063c8-8548-407b-89b6-e42b615300c6 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1663 microversion: 2.1 time: 0.180442 Aug 03 19:09:13.081794 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 224/452] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:09:12 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1663 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:09:14.105733 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-81b55785-668b-4d02-9a41-c709eea908c6 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:14.106333 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-81b55785-668b-4d02-9a41-c709eea908c6 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:09:14.113154 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-81b55785-668b-4d02-9a41-c709eea908c6 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:14.113593 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-81b55785-668b-4d02-9a41-c709eea908c6 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:14.114360 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-81b55785-668b-4d02-9a41-c709eea908c6 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:14.114787 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-81b55785-668b-4d02-9a41-c709eea908c6 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:14.264233 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-81b55785-668b-4d02-9a41-c709eea908c6 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:09:14.272078 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-81b55785-668b-4d02-9a41-c709eea908c6 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1663 microversion: 2.1 time: 0.172426 Aug 03 19:09:14.272691 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 229/453] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:09:14 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1663 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:09:15.294052 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-fbabee53-d0fa-426f-839e-3e52a4899a11 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:15.294672 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-fbabee53-d0fa-426f-839e-3e52a4899a11 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:09:15.301117 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fbabee53-d0fa-426f-839e-3e52a4899a11 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:15.301629 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fbabee53-d0fa-426f-839e-3e52a4899a11 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:15.302453 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fbabee53-d0fa-426f-839e-3e52a4899a11 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:15.302929 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fbabee53-d0fa-426f-839e-3e52a4899a11 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:15.442464 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-fbabee53-d0fa-426f-839e-3e52a4899a11 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:09:15.450446 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-fbabee53-d0fa-426f-839e-3e52a4899a11 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1667 microversion: 2.1 time: 0.160569 Aug 03 19:09:15.451039 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 225/454] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:09:15 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1667 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:09:46.507898 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 19:09:46.508493 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Wed Aug 3 19:09:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 19:10:02.990784 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-63e1144c-98d8-429a-9559-ebb3bdb01d32 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:02.991469 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-63e1144c-98d8-429a-9559-ebb3bdb01d32 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:02.993336 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_api:SELECT=17 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:10:02.993983 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:10:02.999431 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-63e1144c-98d8-429a-9559-ebb3bdb01d32 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:02.999882 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-63e1144c-98d8-429a-9559-ebb3bdb01d32 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:03.000659 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-63e1144c-98d8-429a-9559-ebb3bdb01d32 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:03.001089 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-63e1144c-98d8-429a-9559-ebb3bdb01d32 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:03.098924 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.objects.instance [None req-63e1144c-98d8-429a-9559-ebb3bdb01d32 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lazy-loading 'services' on Instance uuid 87735baf-d677-4920-8453-c829a9e833b9 {{(pid=118303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:10:03.382273 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-63e1144c-98d8-429a-9559-ebb3bdb01d32 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "DELETE /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9/os-volume_attachments/e07f9567-999a-4ed1-9bf9-bb24bb2e81d5" status: 202 len: 0 microversion: 2.1 time: 0.395435 Aug 03 19:10:03.382882 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 230/455] 10.222.0.77 () {58 vars in 1416 bytes} [Wed Aug 3 19:10:02 2022] DELETE /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9/os-volume_attachments/e07f9567-999a-4ed1-9bf9-bb24bb2e81d5 => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 19:10:03.391780 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-3848706c-f9d7-430c-92c3-0be2ef7741fb tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:03.393992 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-3848706c-f9d7-430c-92c3-0be2ef7741fb tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:03.396173 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_api:SELECT=17 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:10:03.396829 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=63 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:10:03.402231 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3848706c-f9d7-430c-92c3-0be2ef7741fb tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:03.402842 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3848706c-f9d7-430c-92c3-0be2ef7741fb tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:03.404077 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3848706c-f9d7-430c-92c3-0be2ef7741fb tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:03.404607 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3848706c-f9d7-430c-92c3-0be2ef7741fb tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:03.448174 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-3848706c-f9d7-430c-92c3-0be2ef7741fb tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060670 Aug 03 19:10:03.448885 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 226/456] 10.222.0.77 () {58 vars in 1302 bytes} [Wed Aug 3 19:10:03 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:10:04.463223 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-8e628612-3215-41df-a1ad-5c795293e2ad tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:04.465606 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-8e628612-3215-41df-a1ad-5c795293e2ad tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:04.473111 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8e628612-3215-41df-a1ad-5c795293e2ad tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:04.473556 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8e628612-3215-41df-a1ad-5c795293e2ad tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:04.474335 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8e628612-3215-41df-a1ad-5c795293e2ad tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:04.474770 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8e628612-3215-41df-a1ad-5c795293e2ad tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:04.505398 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-8e628612-3215-41df-a1ad-5c795293e2ad tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046649 Aug 03 19:10:04.505864 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 231/457] 10.222.0.77 () {58 vars in 1302 bytes} [Wed Aug 3 19:10:04 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:10:05.521605 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-77f8fa2a-7c84-4fff-9fe2-f2eb751413e1 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:05.524040 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-77f8fa2a-7c84-4fff-9fe2-f2eb751413e1 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:05.531951 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-77f8fa2a-7c84-4fff-9fe2-f2eb751413e1 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:05.532379 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-77f8fa2a-7c84-4fff-9fe2-f2eb751413e1 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:05.533159 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-77f8fa2a-7c84-4fff-9fe2-f2eb751413e1 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:05.533630 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-77f8fa2a-7c84-4fff-9fe2-f2eb751413e1 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:05.568066 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-77f8fa2a-7c84-4fff-9fe2-f2eb751413e1 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052110 Aug 03 19:10:05.568631 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 227/458] 10.222.0.77 () {58 vars in 1302 bytes} [Wed Aug 3 19:10:05 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 19:10:05.663044 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-96091062-7a67-4919-9c43-6bf086e10894 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:05.663617 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-96091062-7a67-4919-9c43-6bf086e10894 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:05.670130 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-96091062-7a67-4919-9c43-6bf086e10894 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:05.671033 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-96091062-7a67-4919-9c43-6bf086e10894 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:05.671843 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-96091062-7a67-4919-9c43-6bf086e10894 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:05.672248 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-96091062-7a67-4919-9c43-6bf086e10894 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:05.699701 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-96091062-7a67-4919-9c43-6bf086e10894 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Going to try to terminate instance {{(pid=118303) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 19:10:06.016755 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-96091062-7a67-4919-9c43-6bf086e10894 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "DELETE /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 204 len: 0 microversion: 2.1 time: 0.357577 Aug 03 19:10:06.017478 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 232/459] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 3 19:10:05 2022] DELETE /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 19:10:06.025317 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-b6b1dec7-e781-4c60-8524-9ef67316935e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:06.025928 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-b6b1dec7-e781-4c60-8524-9ef67316935e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:06.032495 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b6b1dec7-e781-4c60-8524-9ef67316935e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:06.032947 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b6b1dec7-e781-4c60-8524-9ef67316935e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:06.033717 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b6b1dec7-e781-4c60-8524-9ef67316935e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:06.034147 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b6b1dec7-e781-4c60-8524-9ef67316935e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:06.177741 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-b6b1dec7-e781-4c60-8524-9ef67316935e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:06.185411 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-b6b1dec7-e781-4c60-8524-9ef67316935e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1688 microversion: 2.1 time: 0.163887 Aug 03 19:10:06.186638 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 228/460] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:06 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:07.219462 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-a52de90e-366e-4ab2-8894-ea9817f4e0e2 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:07.220052 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-a52de90e-366e-4ab2-8894-ea9817f4e0e2 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:07.229700 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a52de90e-366e-4ab2-8894-ea9817f4e0e2 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:07.230151 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a52de90e-366e-4ab2-8894-ea9817f4e0e2 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:07.230921 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a52de90e-366e-4ab2-8894-ea9817f4e0e2 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:07.231385 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a52de90e-366e-4ab2-8894-ea9817f4e0e2 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:07.389886 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-a52de90e-366e-4ab2-8894-ea9817f4e0e2 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:07.406367 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-a52de90e-366e-4ab2-8894-ea9817f4e0e2 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1688 microversion: 2.1 time: 0.191320 Aug 03 19:10:07.406934 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 233/461] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:07 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1688 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:08.430300 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-a4c530bb-a5a8-47d1-af0f-1858fd5bea5f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:08.430924 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-a4c530bb-a5a8-47d1-af0f-1858fd5bea5f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:08.437684 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a4c530bb-a5a8-47d1-af0f-1858fd5bea5f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:08.438129 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a4c530bb-a5a8-47d1-af0f-1858fd5bea5f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:08.438896 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a4c530bb-a5a8-47d1-af0f-1858fd5bea5f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:08.439371 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a4c530bb-a5a8-47d1-af0f-1858fd5bea5f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:08.587702 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-a4c530bb-a5a8-47d1-af0f-1858fd5bea5f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:08.595958 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-a4c530bb-a5a8-47d1-af0f-1858fd5bea5f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1688 microversion: 2.1 time: 0.170179 Aug 03 19:10:08.596564 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 229/462] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:08 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1688 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:09.617448 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-1e9af70b-102e-405e-bc4c-c0bb85dd7644 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:09.618074 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-1e9af70b-102e-405e-bc4c-c0bb85dd7644 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:09.625317 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1e9af70b-102e-405e-bc4c-c0bb85dd7644 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:09.625778 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1e9af70b-102e-405e-bc4c-c0bb85dd7644 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:09.626555 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1e9af70b-102e-405e-bc4c-c0bb85dd7644 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:09.627007 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1e9af70b-102e-405e-bc4c-c0bb85dd7644 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:09.769525 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-1e9af70b-102e-405e-bc4c-c0bb85dd7644 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:09.778000 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-1e9af70b-102e-405e-bc4c-c0bb85dd7644 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1688 microversion: 2.1 time: 0.164551 Aug 03 19:10:09.778557 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 234/463] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:09 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:10.800713 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-d3f6e6c3-b88d-4beb-b286-077431c55f15 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:10.801467 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-d3f6e6c3-b88d-4beb-b286-077431c55f15 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:10.810290 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d3f6e6c3-b88d-4beb-b286-077431c55f15 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:10.811532 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d3f6e6c3-b88d-4beb-b286-077431c55f15 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:10.812789 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d3f6e6c3-b88d-4beb-b286-077431c55f15 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:10.813472 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d3f6e6c3-b88d-4beb-b286-077431c55f15 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:10.915376 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-d3f6e6c3-b88d-4beb-b286-077431c55f15 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:10.927323 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-d3f6e6c3-b88d-4beb-b286-077431c55f15 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1621 microversion: 2.1 time: 0.129934 Aug 03 19:10:10.928517 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 230/464] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:10 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1621 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:10:11.194345 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [req-988896c7-64c7-4d08-95f6-ffe2dce9ad54 req-aa49aceb-7ca3-480a-bc85-575d4eb493c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87735baf-d677-4920-8453-c829a9e833b9", "name": "network-vif-deleted", "tag": "013884d5-b737-4e4b-8a8f-00c6a8b5fbe3"}]} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:10:11.204920 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-988896c7-64c7-4d08-95f6-ffe2dce9ad54 req-aa49aceb-7ca3-480a-bc85-575d4eb493c4 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:11.205361 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-988896c7-64c7-4d08-95f6-ffe2dce9ad54 req-aa49aceb-7ca3-480a-bc85-575d4eb493c4 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:11.219828 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.compute.server_external_events [req-988896c7-64c7-4d08-95f6-ffe2dce9ad54 req-aa49aceb-7ca3-480a-bc85-575d4eb493c4 service nova] Creating event network-vif-deleted:013884d5-b737-4e4b-8a8f-00c6a8b5fbe3 for instance 87735baf-d677-4920-8453-c829a9e833b9 on hv-cinder-85202 Aug 03 19:10:11.226060 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [req-988896c7-64c7-4d08-95f6-ffe2dce9ad54 req-aa49aceb-7ca3-480a-bc85-575d4eb493c4 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103528 Aug 03 19:10:11.228031 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 235/465] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 19:10:11.950354 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-b714da65-bd63-4c51-a46d-c4ad86c274df tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:11.952482 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-b714da65-bd63-4c51-a46d-c4ad86c274df tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:11.959929 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b714da65-bd63-4c51-a46d-c4ad86c274df tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:11.960794 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b714da65-bd63-4c51-a46d-c4ad86c274df tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:11.961753 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b714da65-bd63-4c51-a46d-c4ad86c274df tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:11.962356 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b714da65-bd63-4c51-a46d-c4ad86c274df tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:12.006573 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b714da65-bd63-4c51-a46d-c4ad86c274df tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:12.007509 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b714da65-bd63-4c51-a46d-c4ad86c274df tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:12.008150 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.objects.instance [None req-b714da65-bd63-4c51-a46d-c4ad86c274df tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lazy-loading 'fault' on Instance uuid 87735baf-d677-4920-8453-c829a9e833b9 {{(pid=118302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:10:12.067252 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-b714da65-bd63-4c51-a46d-c4ad86c274df tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:12.078062 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-b714da65-bd63-4c51-a46d-c4ad86c274df tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 200 len: 1335 microversion: 2.1 time: 0.131596 Aug 03 19:10:12.080267 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 231/466] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:11 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 1335 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:13.102897 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-1d31588d-ca2f-4271-ad78-8bfdfca29ee0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:13.103629 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-1d31588d-ca2f-4271-ad78-8bfdfca29ee0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 87735baf-d677-4920-8453-c829a9e833b9] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:13.115569 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1d31588d-ca2f-4271-ad78-8bfdfca29ee0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:13.116143 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1d31588d-ca2f-4271-ad78-8bfdfca29ee0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:13.117082 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1d31588d-ca2f-4271-ad78-8bfdfca29ee0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:13.117790 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1d31588d-ca2f-4271-ad78-8bfdfca29ee0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:13.133581 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.wsgi [None req-1d31588d-ca2f-4271-ad78-8bfdfca29ee0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] HTTP exception thrown: Instance 87735baf-d677-4920-8453-c829a9e833b9 could not be found. Aug 03 19:10:13.135321 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-1d31588d-ca2f-4271-ad78-8bfdfca29ee0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Request method failure captured: Aug 03 19:10:13.135321 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: request: GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 HTTP/1.1 Aug 03 19:10:13.135321 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept: application/json Aug 03 19:10:13.135321 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept-Encoding: identity Aug 03 19:10:13.135321 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Connection: close Aug 03 19:10:13.135321 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Length: 0 Aug 03 19:10:13.135321 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Type: application/json Aug 03 19:10:13.135321 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Host: 10.222.0.77 Aug 03 19:10:13.135321 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Openstack-System-Scope: None Aug 03 19:10:13.135321 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: User-Agent: python-urllib3/1.26.11 Aug 03 19:10:13.135321 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Auth-Token: gAAAAABi6sZpW7w7YQZ3ICnejTi_VA0idBlfsSFO1OcVhcF8hcGMcBJoz1L9T5T64xxPIqj2mDSnq3haUv8vF_XUJoqHhvqS8KjotAxSwLqgNhIXH7oXp4pMLcBvPDn6dBXb26JYx8SgQOYpnZ_y7iEMNLg6DSgl3Ss3QzdBRQ8W6OiIonlfjz4 Aug 03 19:10:13.135321 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Id: None Aug 03 19:10:13.135321 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Name: None Aug 03 19:10:13.135321 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Identity-Status: Confirmed Aug 03 19:10:13.135321 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Is-Admin-Project: True Aug 03 19:10:13.135321 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Id: default Aug 03 19:10:13.135321 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Name: Default Aug 03 19:10:13.135321 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Id: bf009469f935465baa6427ab4951944e Aug 03 19:10:13.135321 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1404930254 Aug 03 19:10:13.135321 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Role: reader,member Aug 03 19:10:13.135321 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Roles: reader,member Aug 03 19:10:13.137017 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_bf009469f935465baa6427ab4951944e", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/bf009469f935465baa6427ab4951944e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/bf009469f935465baa6427ab4951944e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/bf009469f935465baa6427ab4951944e"}]}] Aug 03 19:10:13.137017 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1404930254 Aug 03 19:10:13.137017 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Id: bf009469f935465baa6427ab4951944e Aug 03 19:10:13.137017 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1404930254 Aug 03 19:10:13.137017 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User: tempest-ServerRescueNegativeTestJSON-1404930254-project Aug 03 19:10:13.137017 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Id: default Aug 03 19:10:13.137017 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Name: Default Aug 03 19:10:13.137017 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Id: 9c46900844e8483bb2dff3b9e65df372 Aug 03 19:10:13.137017 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1404930254-project Aug 03 19:10:13.137017 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: method: > Aug 03 19:10:13.137017 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: exception: Instance 87735baf-d677-4920-8453-c829a9e833b9 could not be found. Aug 03 19:10:13.137017 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: action_args: {'id': '87735baf-d677-4920-8453-c829a9e833b9'} Aug 03 19:10:13.137991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:10:13.137991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:10:13.137991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:10:13.137991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:10:13.137991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:10:13.137991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:10:13.137991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:10:13.137991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:10:13.137991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:10:13.137991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:10:13.137991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87735baf-d677-4920-8453-c829a9e833b9 could not be found. Aug 03 19:10:13.137991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:10:13.137991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:10:13.137991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:10:13.137991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:10:13.137991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:10:13.137991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:10:13.137991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:10:13.137991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:10:13.137991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:10:13.140013 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:10:13.140013 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:10:13.140013 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:10:13.140013 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:10:13.140013 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:10:13.140013 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:10:13.140013 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:10:13.140013 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87735baf-d677-4920-8453-c829a9e833b9 could not be found. Aug 03 19:10:13.140013 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:10:13.140013 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:10:13.140013 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:10:13.140013 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:10:13.140013 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:10:13.140013 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:10:13.140013 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:10:13.140013 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:10:13.140013 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87735baf-d677-4920-8453-c829a9e833b9 could not be found. Aug 03 19:10:13.140013 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:10:13.141483 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-1d31588d-ca2f-4271-ad78-8bfdfca29ee0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Returning 404 to user: Instance 87735baf-d677-4920-8453-c829a9e833b9 could not be found. {{(pid=118303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:10:13.141483 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-1d31588d-ca2f-4271-ad78-8bfdfca29ee0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9" status: 404 len: 111 microversion: 2.1 time: 0.039490 Aug 03 19:10:13.141483 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 236/467] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:13 2022] GET /compute/v2.1/servers/87735baf-d677-4920-8453-c829a9e833b9 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:10:13.147179 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-0d061098-7dd1-4ddd-ad31-944ec0602eaa tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '.version_select at 0x7f47863561f0>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:13.252651 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-0d061098-7dd1-4ddd-ad31-944ec0602eaa tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1770038115" status: 202 len: 0 microversion: 2.1 time: 0.109231 Aug 03 19:10:13.253589 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 232/468] 10.222.0.77 () {58 vars in 1221 bytes} [Wed Aug 3 19:10:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1770038115 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 19:10:16.730388 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-584e940a-3663-46fb-a09b-972b04546ce9 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:16.731121 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-584e940a-3663-46fb-a09b-972b04546ce9 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:16.741060 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-584e940a-3663-46fb-a09b-972b04546ce9 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:16.741500 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-584e940a-3663-46fb-a09b-972b04546ce9 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:16.742274 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-584e940a-3663-46fb-a09b-972b04546ce9 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:16.742708 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-584e940a-3663-46fb-a09b-972b04546ce9 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:16.769432 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-584e940a-3663-46fb-a09b-972b04546ce9 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Going to try to terminate instance {{(pid=118303) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 19:10:17.165557 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-584e940a-3663-46fb-a09b-972b04546ce9 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "DELETE /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 204 len: 0 microversion: 2.1 time: 0.438784 Aug 03 19:10:17.166144 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 237/469] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 3 19:10:16 2022] DELETE /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 19:10:17.175444 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-17631600-4854-4cd8-83ea-32106c501196 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:17.176065 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-17631600-4854-4cd8-83ea-32106c501196 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:17.184660 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-17631600-4854-4cd8-83ea-32106c501196 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:17.185139 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-17631600-4854-4cd8-83ea-32106c501196 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:17.186098 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-17631600-4854-4cd8-83ea-32106c501196 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:17.186098 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-17631600-4854-4cd8-83ea-32106c501196 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:17.345518 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-17631600-4854-4cd8-83ea-32106c501196 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:17.357159 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-17631600-4854-4cd8-83ea-32106c501196 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1508 microversion: 2.1 time: 0.186197 Aug 03 19:10:17.358795 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 233/470] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:17 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1508 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:18.381445 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-a7adacde-b124-42a6-a26e-7a3e691ed90e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:18.382203 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-a7adacde-b124-42a6-a26e-7a3e691ed90e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:18.389139 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a7adacde-b124-42a6-a26e-7a3e691ed90e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:18.389590 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a7adacde-b124-42a6-a26e-7a3e691ed90e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:18.390372 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a7adacde-b124-42a6-a26e-7a3e691ed90e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:18.390805 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a7adacde-b124-42a6-a26e-7a3e691ed90e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:18.569566 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-a7adacde-b124-42a6-a26e-7a3e691ed90e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:18.581212 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-a7adacde-b124-42a6-a26e-7a3e691ed90e tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1508 microversion: 2.1 time: 0.205135 Aug 03 19:10:18.582373 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 238/471] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:18 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1508 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:18.679228 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-3b0eab98-4804-436d-8674-75aed05ed660 req-9991e772-1d13-473e-adb6-b531a2c150cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54ad07ab-f23e-4369-8940-65095533457d", "name": "network-vif-deleted", "tag": "14f5d67f-5c4d-441e-993c-111e289fd40a"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:10:18.691966 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-3b0eab98-4804-436d-8674-75aed05ed660 req-9991e772-1d13-473e-adb6-b531a2c150cf service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:18.692410 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-3b0eab98-4804-436d-8674-75aed05ed660 req-9991e772-1d13-473e-adb6-b531a2c150cf service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:18.705463 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-3b0eab98-4804-436d-8674-75aed05ed660 req-9991e772-1d13-473e-adb6-b531a2c150cf service nova] Creating event network-vif-deleted:14f5d67f-5c4d-441e-993c-111e289fd40a for instance 54ad07ab-f23e-4369-8940-65095533457d on hv-cinder-85202 Aug 03 19:10:18.711295 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-3b0eab98-4804-436d-8674-75aed05ed660 req-9991e772-1d13-473e-adb6-b531a2c150cf service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035151 Aug 03 19:10:18.711295 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 234/472] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:10:19.603932 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-c91d151c-e845-40ac-89ef-076336b7bbf8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:19.604480 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-c91d151c-e845-40ac-89ef-076336b7bbf8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:19.611788 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c91d151c-e845-40ac-89ef-076336b7bbf8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:19.612703 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c91d151c-e845-40ac-89ef-076336b7bbf8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:19.613071 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c91d151c-e845-40ac-89ef-076336b7bbf8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:19.613558 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c91d151c-e845-40ac-89ef-076336b7bbf8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:19.648697 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c91d151c-e845-40ac-89ef-076336b7bbf8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:19.649149 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c91d151c-e845-40ac-89ef-076336b7bbf8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:19.649600 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.objects.instance [None req-c91d151c-e845-40ac-89ef-076336b7bbf8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lazy-loading 'fault' on Instance uuid 54ad07ab-f23e-4369-8940-65095533457d {{(pid=118303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:10:19.699365 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-c91d151c-e845-40ac-89ef-076336b7bbf8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:19.710684 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-c91d151c-e845-40ac-89ef-076336b7bbf8 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 200 len: 1312 microversion: 2.1 time: 0.110734 Aug 03 19:10:19.711304 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 239/473] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:19 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 1312 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:10:20.657280 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-3b3f10fc-f8e7-4273-af28-17fba3277429 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:20.659516 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-3b3f10fc-f8e7-4273-af28-17fba3277429 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:20.666284 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3b3f10fc-f8e7-4273-af28-17fba3277429 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:20.666726 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3b3f10fc-f8e7-4273-af28-17fba3277429 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:20.667520 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3b3f10fc-f8e7-4273-af28-17fba3277429 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:20.667946 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3b3f10fc-f8e7-4273-af28-17fba3277429 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:20.698508 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-3b3f10fc-f8e7-4273-af28-17fba3277429 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046691 Aug 03 19:10:20.699111 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 235/474] 10.222.0.77 () {58 vars in 1302 bytes} [Wed Aug 3 19:10:20 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 19:10:20.734173 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-d742e64a-433a-4860-86f4-81220a5a22f0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:20.734768 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-d742e64a-433a-4860-86f4-81220a5a22f0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 54ad07ab-f23e-4369-8940-65095533457d] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:20.741502 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d742e64a-433a-4860-86f4-81220a5a22f0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:20.742201 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d742e64a-433a-4860-86f4-81220a5a22f0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:20.743006 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d742e64a-433a-4860-86f4-81220a5a22f0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:20.743468 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d742e64a-433a-4860-86f4-81220a5a22f0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:20.758735 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.wsgi [None req-d742e64a-433a-4860-86f4-81220a5a22f0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] HTTP exception thrown: Instance 54ad07ab-f23e-4369-8940-65095533457d could not be found. Aug 03 19:10:20.760531 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-d742e64a-433a-4860-86f4-81220a5a22f0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Request method failure captured: Aug 03 19:10:20.760531 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: request: GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d HTTP/1.1 Aug 03 19:10:20.760531 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept: application/json Aug 03 19:10:20.760531 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept-Encoding: identity Aug 03 19:10:20.760531 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Connection: close Aug 03 19:10:20.760531 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Length: 0 Aug 03 19:10:20.760531 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Type: application/json Aug 03 19:10:20.760531 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Host: 10.222.0.77 Aug 03 19:10:20.760531 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Openstack-System-Scope: None Aug 03 19:10:20.760531 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: User-Agent: python-urllib3/1.26.11 Aug 03 19:10:20.760531 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Auth-Token: gAAAAABi6sZpW7w7YQZ3ICnejTi_VA0idBlfsSFO1OcVhcF8hcGMcBJoz1L9T5T64xxPIqj2mDSnq3haUv8vF_XUJoqHhvqS8KjotAxSwLqgNhIXH7oXp4pMLcBvPDn6dBXb26JYx8SgQOYpnZ_y7iEMNLg6DSgl3Ss3QzdBRQ8W6OiIonlfjz4 Aug 03 19:10:20.760531 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Id: None Aug 03 19:10:20.760531 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Name: None Aug 03 19:10:20.760531 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Identity-Status: Confirmed Aug 03 19:10:20.760531 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Is-Admin-Project: True Aug 03 19:10:20.760531 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Id: default Aug 03 19:10:20.760531 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Name: Default Aug 03 19:10:20.760531 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Id: bf009469f935465baa6427ab4951944e Aug 03 19:10:20.760531 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1404930254 Aug 03 19:10:20.760531 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Role: reader,member Aug 03 19:10:20.760531 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Roles: reader,member Aug 03 19:10:20.762026 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_bf009469f935465baa6427ab4951944e", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/bf009469f935465baa6427ab4951944e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/bf009469f935465baa6427ab4951944e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/bf009469f935465baa6427ab4951944e"}]}] Aug 03 19:10:20.762026 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1404930254 Aug 03 19:10:20.762026 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Id: bf009469f935465baa6427ab4951944e Aug 03 19:10:20.762026 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1404930254 Aug 03 19:10:20.762026 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User: tempest-ServerRescueNegativeTestJSON-1404930254-project Aug 03 19:10:20.762026 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Id: default Aug 03 19:10:20.762026 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Name: Default Aug 03 19:10:20.762026 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Id: 9c46900844e8483bb2dff3b9e65df372 Aug 03 19:10:20.762026 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1404930254-project Aug 03 19:10:20.762026 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: method: > Aug 03 19:10:20.762026 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: exception: Instance 54ad07ab-f23e-4369-8940-65095533457d could not be found. Aug 03 19:10:20.762026 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: action_args: {'id': '54ad07ab-f23e-4369-8940-65095533457d'} Aug 03 19:10:20.762886 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:10:20.762886 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:10:20.762886 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:10:20.762886 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:10:20.762886 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:10:20.762886 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:10:20.762886 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:10:20.762886 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:10:20.762886 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:10:20.762886 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:10:20.762886 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54ad07ab-f23e-4369-8940-65095533457d could not be found. Aug 03 19:10:20.762886 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:10:20.762886 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:10:20.762886 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:10:20.762886 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:10:20.762886 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:10:20.762886 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:10:20.762886 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:10:20.762886 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:10:20.762886 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:10:20.764234 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:10:20.764234 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:10:20.764234 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:10:20.764234 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:10:20.764234 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:10:20.764234 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:10:20.764234 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:10:20.764234 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54ad07ab-f23e-4369-8940-65095533457d could not be found. Aug 03 19:10:20.764234 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:10:20.764234 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:10:20.764234 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:10:20.764234 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:10:20.764234 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:10:20.764234 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:10:20.764234 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:10:20.764234 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:10:20.764234 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54ad07ab-f23e-4369-8940-65095533457d could not be found. Aug 03 19:10:20.764234 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:10:20.765965 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-d742e64a-433a-4860-86f4-81220a5a22f0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Returning 404 to user: Instance 54ad07ab-f23e-4369-8940-65095533457d could not be found. {{(pid=118303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:10:20.765965 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-d742e64a-433a-4860-86f4-81220a5a22f0 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d" status: 404 len: 111 microversion: 2.1 time: 0.032081 Aug 03 19:10:20.765965 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 240/475] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:20 2022] GET /compute/v2.1/servers/54ad07ab-f23e-4369-8940-65095533457d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:10:20.766204 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-384cbb59-bf3a-419b-9773-2542f9d4ab47 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:20.766204 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-384cbb59-bf3a-419b-9773-2542f9d4ab47 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:20.773003 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-384cbb59-bf3a-419b-9773-2542f9d4ab47 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:20.773595 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-384cbb59-bf3a-419b-9773-2542f9d4ab47 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:20.774058 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-1bc71ec9-3b73-4619-9693-397d7a1cb107 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:20.774426 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-384cbb59-bf3a-419b-9773-2542f9d4ab47 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:20.774594 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-1bc71ec9-3b73-4619-9693-397d7a1cb107 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:20.774872 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-384cbb59-bf3a-419b-9773-2542f9d4ab47 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:20.781499 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1bc71ec9-3b73-4619-9693-397d7a1cb107 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:20.782103 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1bc71ec9-3b73-4619-9693-397d7a1cb107 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:20.782890 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1bc71ec9-3b73-4619-9693-397d7a1cb107 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:20.783368 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1bc71ec9-3b73-4619-9693-397d7a1cb107 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:20.802160 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-384cbb59-bf3a-419b-9773-2542f9d4ab47 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Going to try to terminate instance {{(pid=118302) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 19:10:20.810597 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-1bc71ec9-3b73-4619-9693-397d7a1cb107 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Going to try to terminate instance {{(pid=118303) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 19:10:21.193763 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-384cbb59-bf3a-419b-9773-2542f9d4ab47 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "DELETE /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 204 len: 0 microversion: 2.1 time: 0.433039 Aug 03 19:10:21.194531 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 236/476] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 3 19:10:20 2022] DELETE /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 19:10:21.203402 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-7c4dbf93-aeb5-441e-a77d-ed4fd3885643 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:21.204109 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-7c4dbf93-aeb5-441e-a77d-ed4fd3885643 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:21.211546 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7c4dbf93-aeb5-441e-a77d-ed4fd3885643 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:21.212000 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7c4dbf93-aeb5-441e-a77d-ed4fd3885643 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:21.212773 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7c4dbf93-aeb5-441e-a77d-ed4fd3885643 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:21.213210 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7c4dbf93-aeb5-441e-a77d-ed4fd3885643 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:21.247520 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-1bc71ec9-3b73-4619-9693-397d7a1cb107 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "DELETE /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a" status: 204 len: 0 microversion: 2.1 time: 0.476922 Aug 03 19:10:21.248136 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 241/477] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 3 19:10:20 2022] DELETE /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 19:10:21.258151 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-f242764e-0118-468c-b5ef-10c1ab10f67a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:21.258862 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-f242764e-0118-468c-b5ef-10c1ab10f67a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:21.265452 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f242764e-0118-468c-b5ef-10c1ab10f67a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:21.265906 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f242764e-0118-468c-b5ef-10c1ab10f67a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:21.266685 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f242764e-0118-468c-b5ef-10c1ab10f67a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:21.267192 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f242764e-0118-468c-b5ef-10c1ab10f67a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:21.289605 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:10:21.421335 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-7c4dbf93-aeb5-441e-a77d-ed4fd3885643 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:21.430205 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-7c4dbf93-aeb5-441e-a77d-ed4fd3885643 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1673 microversion: 2.1 time: 0.230937 Aug 03 19:10:21.430814 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 237/478] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:21 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1673 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:21.452152 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-f242764e-0118-468c-b5ef-10c1ab10f67a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:21.459993 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-f242764e-0118-468c-b5ef-10c1ab10f67a tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a" status: 200 len: 1522 microversion: 2.1 time: 0.206225 Aug 03 19:10:21.460553 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 242/479] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:21 2022] GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:22.453297 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-38bd8a15-2c9f-4d5e-9223-683ab3f15691 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:22.453884 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-38bd8a15-2c9f-4d5e-9223-683ab3f15691 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:22.460363 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-38bd8a15-2c9f-4d5e-9223-683ab3f15691 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:22.460808 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-38bd8a15-2c9f-4d5e-9223-683ab3f15691 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:22.461564 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-38bd8a15-2c9f-4d5e-9223-683ab3f15691 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:22.461996 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-38bd8a15-2c9f-4d5e-9223-683ab3f15691 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:22.480620 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-f5e11190-4a85-43ca-b89e-0934616b1e10 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:22.481225 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-f5e11190-4a85-43ca-b89e-0934616b1e10 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:22.488384 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f5e11190-4a85-43ca-b89e-0934616b1e10 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:22.488832 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f5e11190-4a85-43ca-b89e-0934616b1e10 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:22.489598 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f5e11190-4a85-43ca-b89e-0934616b1e10 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:22.490030 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f5e11190-4a85-43ca-b89e-0934616b1e10 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:22.658644 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-38bd8a15-2c9f-4d5e-9223-683ab3f15691 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:22.666470 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-38bd8a15-2c9f-4d5e-9223-683ab3f15691 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1673 microversion: 2.1 time: 0.218195 Aug 03 19:10:22.667056 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 238/480] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:22 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1673 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:22.675765 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-f5e11190-4a85-43ca-b89e-0934616b1e10 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:22.683895 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-f5e11190-4a85-43ca-b89e-0934616b1e10 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a" status: 200 len: 1522 microversion: 2.1 time: 0.207145 Aug 03 19:10:22.684458 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 243/481] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:22 2022] GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:10:23.688721 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-38f29f63-448c-4bb5-912a-43401d7749e6 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:23.689616 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-38f29f63-448c-4bb5-912a-43401d7749e6 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:23.696468 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-38f29f63-448c-4bb5-912a-43401d7749e6 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:23.696910 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-38f29f63-448c-4bb5-912a-43401d7749e6 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:23.697691 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-38f29f63-448c-4bb5-912a-43401d7749e6 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:23.698120 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-38f29f63-448c-4bb5-912a-43401d7749e6 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:23.708033 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-ccd71a16-09e1-4891-8ec8-34a8f04f8eb9 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:23.708903 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-ccd71a16-09e1-4891-8ec8-34a8f04f8eb9 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:23.717673 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ccd71a16-09e1-4891-8ec8-34a8f04f8eb9 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:23.724166 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ccd71a16-09e1-4891-8ec8-34a8f04f8eb9 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:23.724924 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ccd71a16-09e1-4891-8ec8-34a8f04f8eb9 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:23.725383 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ccd71a16-09e1-4891-8ec8-34a8f04f8eb9 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:24.203438 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-ccd71a16-09e1-4891-8ec8-34a8f04f8eb9 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:24.206133 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-ccd71a16-09e1-4891-8ec8-34a8f04f8eb9 tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a" status: 200 len: 1522 microversion: 2.1 time: 0.502924 Aug 03 19:10:24.211832 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-38f29f63-448c-4bb5-912a-43401d7749e6 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:24.217845 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 244/482] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:23 2022] GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a => generated 1522 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:10:24.222632 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-38f29f63-448c-4bb5-912a-43401d7749e6 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1673 microversion: 2.1 time: 0.538185 Aug 03 19:10:24.223382 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 239/483] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:23 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1673 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:24.594938 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [req-6da7c58e-917a-4eb0-ba9f-2f3d46e8e3de req-2b488b54-16c2-4b29-b0cc-0aca3c8b36b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82aa6775-8d66-4d67-af69-104454485a2a", "name": "network-vif-deleted", "tag": "1932c7bb-4cf4-4b3d-af32-ca8b71b79229"}]} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:10:24.608627 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-6da7c58e-917a-4eb0-ba9f-2f3d46e8e3de req-2b488b54-16c2-4b29-b0cc-0aca3c8b36b1 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:24.610630 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-6da7c58e-917a-4eb0-ba9f-2f3d46e8e3de req-2b488b54-16c2-4b29-b0cc-0aca3c8b36b1 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:24.622783 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.compute.server_external_events [req-6da7c58e-917a-4eb0-ba9f-2f3d46e8e3de req-2b488b54-16c2-4b29-b0cc-0aca3c8b36b1 service nova] Creating event network-vif-deleted:1932c7bb-4cf4-4b3d-af32-ca8b71b79229 for instance 82aa6775-8d66-4d67-af69-104454485a2a on hv-cinder-85202 Aug 03 19:10:24.632707 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [req-6da7c58e-917a-4eb0-ba9f-2f3d46e8e3de req-2b488b54-16c2-4b29-b0cc-0aca3c8b36b1 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042728 Aug 03 19:10:24.633442 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 245/484] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:10:24.935523 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-0568f1cc-d81a-4cdf-b7cd-62dbb08d53c4 req-563cf30e-556b-47d8-b13f-ddfa9007ed36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfa72c86-34b7-4dc4-b363-fed702f0cebd", "name": "network-vif-deleted", "tag": "5fb218a1-3622-40cd-840f-fa1f0a049e67"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:10:24.961330 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-0568f1cc-d81a-4cdf-b7cd-62dbb08d53c4 req-563cf30e-556b-47d8-b13f-ddfa9007ed36 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:24.962340 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-0568f1cc-d81a-4cdf-b7cd-62dbb08d53c4 req-563cf30e-556b-47d8-b13f-ddfa9007ed36 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:24.985538 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-0568f1cc-d81a-4cdf-b7cd-62dbb08d53c4 req-563cf30e-556b-47d8-b13f-ddfa9007ed36 service nova] Creating event network-vif-deleted:5fb218a1-3622-40cd-840f-fa1f0a049e67 for instance cfa72c86-34b7-4dc4-b363-fed702f0cebd on hv-cinder-85202 Aug 03 19:10:24.991674 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-0568f1cc-d81a-4cdf-b7cd-62dbb08d53c4 req-563cf30e-556b-47d8-b13f-ddfa9007ed36 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060646 Aug 03 19:10:24.992960 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 240/485] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:10:25.228927 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-7f5f6f3d-3359-4454-a538-9bea7d221aab tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:25.229640 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-7f5f6f3d-3359-4454-a538-9bea7d221aab tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:25.238225 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-7f5f6f3d-3359-4454-a538-9bea7d221aab tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:25.238560 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-7f5f6f3d-3359-4454-a538-9bea7d221aab tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:25.239910 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-7f5f6f3d-3359-4454-a538-9bea7d221aab tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:25.240521 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-7f5f6f3d-3359-4454-a538-9bea7d221aab tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:25.246639 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-d4b40bf5-c38f-4a9a-8637-e25c40ad3602 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:25.247490 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-d4b40bf5-c38f-4a9a-8637-e25c40ad3602 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:25.257118 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d4b40bf5-c38f-4a9a-8637-e25c40ad3602 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:25.257559 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d4b40bf5-c38f-4a9a-8637-e25c40ad3602 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:25.258414 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d4b40bf5-c38f-4a9a-8637-e25c40ad3602 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:25.258962 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d4b40bf5-c38f-4a9a-8637-e25c40ad3602 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:25.277111 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-7f5f6f3d-3359-4454-a538-9bea7d221aab tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:25.277559 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-7f5f6f3d-3359-4454-a538-9bea7d221aab tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:25.278016 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.objects.instance [None req-7f5f6f3d-3359-4454-a538-9bea7d221aab tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lazy-loading 'fault' on Instance uuid 82aa6775-8d66-4d67-af69-104454485a2a {{(pid=118303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:10:25.346026 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-7f5f6f3d-3359-4454-a538-9bea7d221aab tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c46900844e8483bb2dff3b9e65df372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf009469f935465baa6427ab4951944e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:25.353629 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-7f5f6f3d-3359-4454-a538-9bea7d221aab tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a" status: 200 len: 1311 microversion: 2.1 time: 0.129714 Aug 03 19:10:25.361138 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 246/486] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:25 2022] GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a => generated 1311 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:25.366642 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-d4b40bf5-c38f-4a9a-8637-e25c40ad3602 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:25.376170 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-d4b40bf5-c38f-4a9a-8637-e25c40ad3602 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1322 microversion: 2.1 time: 0.135024 Aug 03 19:10:25.376754 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 241/487] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:25 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1322 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:26.375290 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-854be0e4-daf4-4376-ab60-589ad39bf52f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:26.375895 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-854be0e4-daf4-4376-ab60-589ad39bf52f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] [instance: 82aa6775-8d66-4d67-af69-104454485a2a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:26.382623 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-854be0e4-daf4-4376-ab60-589ad39bf52f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:26.383119 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-854be0e4-daf4-4376-ab60-589ad39bf52f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:26.383898 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-854be0e4-daf4-4376-ab60-589ad39bf52f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:26.384333 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-854be0e4-daf4-4376-ab60-589ad39bf52f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:26.399647 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-f4cda940-161d-4737-85cf-76a0fba58072 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:26.400395 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.wsgi [None req-854be0e4-daf4-4376-ab60-589ad39bf52f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] HTTP exception thrown: Instance 82aa6775-8d66-4d67-af69-104454485a2a could not be found. Aug 03 19:10:26.400525 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-f4cda940-161d-4737-85cf-76a0fba58072 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:26.401291 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-854be0e4-daf4-4376-ab60-589ad39bf52f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Request method failure captured: Aug 03 19:10:26.401291 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: request: GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a HTTP/1.1 Aug 03 19:10:26.401291 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept: application/json Aug 03 19:10:26.401291 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept-Encoding: identity Aug 03 19:10:26.401291 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Connection: close Aug 03 19:10:26.401291 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Length: 0 Aug 03 19:10:26.401291 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Type: application/json Aug 03 19:10:26.401291 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Host: 10.222.0.77 Aug 03 19:10:26.401291 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Openstack-System-Scope: None Aug 03 19:10:26.401291 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: User-Agent: python-urllib3/1.26.11 Aug 03 19:10:26.401291 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Auth-Token: gAAAAABi6sZpW7w7YQZ3ICnejTi_VA0idBlfsSFO1OcVhcF8hcGMcBJoz1L9T5T64xxPIqj2mDSnq3haUv8vF_XUJoqHhvqS8KjotAxSwLqgNhIXH7oXp4pMLcBvPDn6dBXb26JYx8SgQOYpnZ_y7iEMNLg6DSgl3Ss3QzdBRQ8W6OiIonlfjz4 Aug 03 19:10:26.401291 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Id: None Aug 03 19:10:26.401291 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Name: None Aug 03 19:10:26.401291 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Identity-Status: Confirmed Aug 03 19:10:26.401291 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Is-Admin-Project: True Aug 03 19:10:26.401291 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Id: default Aug 03 19:10:26.401291 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Name: Default Aug 03 19:10:26.401291 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Id: bf009469f935465baa6427ab4951944e Aug 03 19:10:26.401291 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1404930254 Aug 03 19:10:26.401291 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Role: reader,member Aug 03 19:10:26.401291 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Roles: reader,member Aug 03 19:10:26.403555 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_bf009469f935465baa6427ab4951944e", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/bf009469f935465baa6427ab4951944e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/bf009469f935465baa6427ab4951944e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/bf009469f935465baa6427ab4951944e"}]}] Aug 03 19:10:26.403555 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1404930254 Aug 03 19:10:26.403555 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Id: bf009469f935465baa6427ab4951944e Aug 03 19:10:26.403555 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1404930254 Aug 03 19:10:26.403555 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User: tempest-ServerRescueNegativeTestJSON-1404930254-project Aug 03 19:10:26.403555 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Id: default Aug 03 19:10:26.403555 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Name: Default Aug 03 19:10:26.403555 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Id: 9c46900844e8483bb2dff3b9e65df372 Aug 03 19:10:26.403555 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1404930254-project Aug 03 19:10:26.403555 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: method: > Aug 03 19:10:26.403555 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: exception: Instance 82aa6775-8d66-4d67-af69-104454485a2a could not be found. Aug 03 19:10:26.403555 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: action_args: {'id': '82aa6775-8d66-4d67-af69-104454485a2a'} Aug 03 19:10:26.405113 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:10:26.405113 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:10:26.405113 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:10:26.405113 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:10:26.405113 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:10:26.405113 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:10:26.405113 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:10:26.405113 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:10:26.405113 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:10:26.405113 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:10:26.405113 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82aa6775-8d66-4d67-af69-104454485a2a could not be found. Aug 03 19:10:26.405113 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:10:26.405113 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:10:26.405113 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:10:26.405113 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:10:26.405113 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:10:26.405113 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:10:26.405113 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:10:26.405113 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:10:26.405113 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:10:26.407149 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:10:26.407149 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:10:26.407149 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:10:26.407149 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:10:26.407149 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:10:26.407149 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:10:26.407149 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:10:26.407149 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82aa6775-8d66-4d67-af69-104454485a2a could not be found. Aug 03 19:10:26.407149 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:10:26.407149 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:10:26.407149 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:10:26.407149 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:10:26.407149 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:10:26.407149 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:10:26.407149 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:10:26.407149 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:10:26.407149 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82aa6775-8d66-4d67-af69-104454485a2a could not be found. Aug 03 19:10:26.407149 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:10:26.408900 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-854be0e4-daf4-4376-ab60-589ad39bf52f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] Returning 404 to user: Instance 82aa6775-8d66-4d67-af69-104454485a2a could not be found. {{(pid=118303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:10:26.408900 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-854be0e4-daf4-4376-ab60-589ad39bf52f tempest-ServerRescueNegativeTestJSON-1404930254 tempest-ServerRescueNegativeTestJSON-1404930254-project] 10.222.0.77 "GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a" status: 404 len: 111 microversion: 2.1 time: 0.031571 Aug 03 19:10:26.408900 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 247/488] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:26 2022] GET /compute/v2.1/servers/82aa6775-8d66-4d67-af69-104454485a2a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:10:26.409700 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f4cda940-161d-4737-85cf-76a0fba58072 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:26.410094 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f4cda940-161d-4737-85cf-76a0fba58072 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:26.410882 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f4cda940-161d-4737-85cf-76a0fba58072 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:26.411355 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f4cda940-161d-4737-85cf-76a0fba58072 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:26.449356 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f4cda940-161d-4737-85cf-76a0fba58072 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:26.449813 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f4cda940-161d-4737-85cf-76a0fba58072 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:26.450274 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.objects.instance [None req-f4cda940-161d-4737-85cf-76a0fba58072 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lazy-loading 'fault' on Instance uuid cfa72c86-34b7-4dc4-b363-fed702f0cebd {{(pid=118302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:10:26.454378 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:10:26.511163 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-f4cda940-161d-4737-85cf-76a0fba58072 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:26.511342 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-f4cda940-161d-4737-85cf-76a0fba58072 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 200 len: 1327 microversion: 2.1 time: 0.115596 Aug 03 19:10:26.511877 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 242/489] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:26 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 1327 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:27.534721 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-fe0c7675-7575-4e13-a787-be87a97814ea tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:27.535347 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-fe0c7675-7575-4e13-a787-be87a97814ea tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:27.542110 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fe0c7675-7575-4e13-a787-be87a97814ea tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:27.542549 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fe0c7675-7575-4e13-a787-be87a97814ea tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:27.543334 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fe0c7675-7575-4e13-a787-be87a97814ea tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:27.543766 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fe0c7675-7575-4e13-a787-be87a97814ea tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:27.557733 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.wsgi [None req-fe0c7675-7575-4e13-a787-be87a97814ea tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] HTTP exception thrown: Instance cfa72c86-34b7-4dc4-b363-fed702f0cebd could not be found. Aug 03 19:10:27.559205 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-fe0c7675-7575-4e13-a787-be87a97814ea tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Request method failure captured: Aug 03 19:10:27.559205 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: request: GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd HTTP/1.1 Aug 03 19:10:27.559205 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept: application/json Aug 03 19:10:27.559205 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept-Encoding: identity Aug 03 19:10:27.559205 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Connection: close Aug 03 19:10:27.559205 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Length: 0 Aug 03 19:10:27.559205 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Type: application/json Aug 03 19:10:27.559205 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Host: 10.222.0.77 Aug 03 19:10:27.559205 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Openstack-System-Scope: None Aug 03 19:10:27.559205 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: User-Agent: python-urllib3/1.26.11 Aug 03 19:10:27.559205 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Auth-Token: gAAAAABi6sZqChsFozggvh0Km-XJ6YDoKUPqx1afjEMs7y-tj_7Q51D0wQUEbmpk5edLz2agtrNzJCwCFcC47j4GzEGtQH4ucz5TBNRprW7Old2AJZW3b17ewEIW-1AELKEvZhRJF16VeljjlGAHIXRaYq0YPHvVTSnnIbe0wEnrS9nCOvLFb10 Aug 03 19:10:27.559205 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Id: None Aug 03 19:10:27.559205 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Name: None Aug 03 19:10:27.559205 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Identity-Status: Confirmed Aug 03 19:10:27.559205 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Is-Admin-Project: True Aug 03 19:10:27.559205 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Id: default Aug 03 19:10:27.559205 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Name: Default Aug 03 19:10:27.559205 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Id: 7d6df5e1251345209a0de754a734e8ec Aug 03 19:10:27.559205 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Name: tempest-AttachVolumeTestJSON-154589076 Aug 03 19:10:27.559205 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Role: reader,member Aug 03 19:10:27.559205 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Roles: reader,member Aug 03 19:10:27.560796 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_7d6df5e1251345209a0de754a734e8ec", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/7d6df5e1251345209a0de754a734e8ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/7d6df5e1251345209a0de754a734e8ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/7d6df5e1251345209a0de754a734e8ec"}]}] Aug 03 19:10:27.560796 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant: tempest-AttachVolumeTestJSON-154589076 Aug 03 19:10:27.560796 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Id: 7d6df5e1251345209a0de754a734e8ec Aug 03 19:10:27.560796 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Name: tempest-AttachVolumeTestJSON-154589076 Aug 03 19:10:27.560796 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User: tempest-AttachVolumeTestJSON-154589076-project Aug 03 19:10:27.560796 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Id: default Aug 03 19:10:27.560796 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Name: Default Aug 03 19:10:27.560796 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Id: 4fb68ecd7a9240948d6b5983f280e649 Aug 03 19:10:27.560796 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Name: tempest-AttachVolumeTestJSON-154589076-project Aug 03 19:10:27.560796 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: method: > Aug 03 19:10:27.560796 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: exception: Instance cfa72c86-34b7-4dc4-b363-fed702f0cebd could not be found. Aug 03 19:10:27.560796 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: action_args: {'id': 'cfa72c86-34b7-4dc4-b363-fed702f0cebd'} Aug 03 19:10:27.561659 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:10:27.561659 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:10:27.561659 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:10:27.561659 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:10:27.561659 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:10:27.561659 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:10:27.561659 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:10:27.561659 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:10:27.561659 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:10:27.561659 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:10:27.561659 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfa72c86-34b7-4dc4-b363-fed702f0cebd could not be found. Aug 03 19:10:27.561659 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:10:27.561659 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:10:27.561659 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:10:27.561659 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:10:27.561659 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:10:27.561659 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:10:27.561659 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:10:27.561659 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:10:27.561659 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:10:27.563145 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:10:27.563145 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:10:27.563145 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:10:27.563145 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:10:27.563145 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:10:27.563145 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:10:27.563145 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:10:27.563145 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfa72c86-34b7-4dc4-b363-fed702f0cebd could not be found. Aug 03 19:10:27.563145 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:10:27.563145 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:10:27.563145 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:10:27.563145 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:10:27.563145 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:10:27.563145 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:10:27.563145 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:10:27.563145 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:10:27.563145 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfa72c86-34b7-4dc4-b363-fed702f0cebd could not be found. Aug 03 19:10:27.563145 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:10:27.564258 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-fe0c7675-7575-4e13-a787-be87a97814ea tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Returning 404 to user: Instance cfa72c86-34b7-4dc4-b363-fed702f0cebd could not be found. {{(pid=118303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:10:27.564258 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-fe0c7675-7575-4e13-a787-be87a97814ea tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 404 len: 111 microversion: 2.1 time: 0.030900 Aug 03 19:10:27.564258 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 248/490] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:27 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:10:27.570133 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-99f78ab5-fd4a-4309-af95-f780090f6de8 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '.version_select at 0x7f47862ca700>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:27.697695 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-99f78ab5-fd4a-4309-af95-f780090f6de8 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-332503108" status: 202 len: 0 microversion: 2.1 time: 0.131484 Aug 03 19:10:27.698648 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 243/491] 10.222.0.77 () {58 vars in 1218 bytes} [Wed Aug 3 19:10:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-332503108 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 19:10:29.229961 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-4151e82c-f803-4b23-bf30-833f65846b80 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Action: 'create', calling method: .version_select at 0x7f47862f85e0>, body: {"keypair": {"name": "tempest-keypair-472322774", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlQuGU/A073jG//3ty4uwqGA9PiUpH5ylUlxD+J85TYKdno8+/hvxbeEUwabf6KMTWyRiwnzogAiPUXH/haw69SuC9/P2D+K7Lg7mMFKJCTRsPQGjQGmA5AL/jtAxX7nQ=="}} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:10:29.252635 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.quota [None req-4151e82c-f803-4b23-bf30-833f65846b80 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Getting quotas for project 7d6df5e1251345209a0de754a734e8ec. Resources: {'key_pairs'} {{(pid=118303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:10:29.257356 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.quota [None req-4151e82c-f803-4b23-bf30-833f65846b80 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Getting quotas for user 4fb68ecd7a9240948d6b5983f280e649 and project 7d6df5e1251345209a0de754a734e8ec. Resources: {'key_pairs'} {{(pid=118303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:10:29.403936 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-4151e82c-f803-4b23-bf30-833f65846b80 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.178119 Aug 03 19:10:29.404941 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 249/492] 10.222.0.77 () {60 vars in 1159 bytes} [Wed Aug 3 19:10:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:10:31.138933 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-fa54d9d4-fb5e-4715-bc8d-3ecec1fd8cb9 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:10:31.144765 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-fa54d9d4-fb5e-4715-bc8d-3ecec1fd8cb9 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:31.149156 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fa54d9d4-fb5e-4715-bc8d-3ecec1fd8cb9 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:31.149731 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fa54d9d4-fb5e-4715-bc8d-3ecec1fd8cb9 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:31.150612 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fa54d9d4-fb5e-4715-bc8d-3ecec1fd8cb9 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:31.151338 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fa54d9d4-fb5e-4715-bc8d-3ecec1fd8cb9 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:31.178577 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.objects.instance [None req-fa54d9d4-fb5e-4715-bc8d-3ecec1fd8cb9 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lazy-loading 'flavor' on Instance uuid 2c5a48c7-6f8c-4016-9bdc-257578d6c207 {{(pid=118302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:10:31.850318 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-fa54d9d4-fb5e-4715-bc8d-3ecec1fd8cb9 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "POST /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207/action" status: 202 len: 0 microversion: 2.1 time: 0.716690 Aug 03 19:10:31.851336 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 244/493] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 3 19:10:31 2022] POST /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207/action => generated 0 bytes in 719 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 19:10:31.861839 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-25f7fece-08de-44b0-9444-cd2723b51026 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:31.863163 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-25f7fece-08de-44b0-9444-cd2723b51026 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:31.872794 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-25f7fece-08de-44b0-9444-cd2723b51026 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:31.873885 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-25f7fece-08de-44b0-9444-cd2723b51026 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:31.874118 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-25f7fece-08de-44b0-9444-cd2723b51026 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:31.874802 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-25f7fece-08de-44b0-9444-cd2723b51026 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:32.193679 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-25f7fece-08de-44b0-9444-cd2723b51026 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:32.201639 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-25f7fece-08de-44b0-9444-cd2723b51026 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1568 microversion: 2.1 time: 0.345533 Aug 03 19:10:32.202274 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 250/494] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:31 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1568 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:32.828362 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-6bca52e1-54f6-46cd-8318-59ae308c3158 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-423527747", "imageRef": "0b6be242-215e-4886-a0d2-b8d5f8ca623e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5f6d75e2-e6cd-4ad1-b885-b8d0b189fc53"}], "security_groups": [{"name": "tempest-securitygroup--33197903"}], "key_name": "tempest-keypair-472322774", "user_data": "}} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:10:32.944506 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.network.neutron [None req-6bca52e1-54f6-46cd-8318-59ae308c3158 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] validate_networks() for [('5f6d75e2-e6cd-4ad1-b885-b8d0b189fc53', None, None, None, None, None)] {{(pid=118302) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 19:10:33.226753 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-d522b6d6-cdfc-410d-9e54-fa817c0b27fb tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:33.227539 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-d522b6d6-cdfc-410d-9e54-fa817c0b27fb tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:33.230240 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:10:33.236332 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d522b6d6-cdfc-410d-9e54-fa817c0b27fb tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:33.237255 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d522b6d6-cdfc-410d-9e54-fa817c0b27fb tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:33.238279 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d522b6d6-cdfc-410d-9e54-fa817c0b27fb tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:33.238770 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d522b6d6-cdfc-410d-9e54-fa817c0b27fb tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:33.485594 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-d522b6d6-cdfc-410d-9e54-fa817c0b27fb tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:33.493970 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-d522b6d6-cdfc-410d-9e54-fa817c0b27fb tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1568 microversion: 2.1 time: 0.271116 Aug 03 19:10:33.494526 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 251/495] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:33 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1568 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:33.593180 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-6bca52e1-54f6-46cd-8318-59ae308c3158 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Flavor limits 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 19:10:33.597540 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-6bca52e1-54f6-46cd-8318-59ae308c3158 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Image limits 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 19:10:33.597540 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-6bca52e1-54f6-46cd-8318-59ae308c3158 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Flavor pref 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 19:10:33.597540 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-6bca52e1-54f6-46cd-8318-59ae308c3158 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Image pref 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 19:10:33.597540 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-6bca52e1-54f6-46cd-8318-59ae308c3158 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 19:10:33.605431 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-6bca52e1-54f6-46cd-8318-59ae308c3158 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:33.605874 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-6bca52e1-54f6-46cd-8318-59ae308c3158 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:33.606663 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-6bca52e1-54f6-46cd-8318-59ae308c3158 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:33.607129 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-6bca52e1-54f6-46cd-8318-59ae308c3158 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:33.627696 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.quota [None req-6bca52e1-54f6-46cd-8318-59ae308c3158 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Getting quotas for project 7d6df5e1251345209a0de754a734e8ec. Resources: {'instances', 'cores', 'ram'} {{(pid=118302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:10:33.637602 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.quota [None req-6bca52e1-54f6-46cd-8318-59ae308c3158 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Getting quotas for user 4fb68ecd7a9240948d6b5983f280e649 and project 7d6df5e1251345209a0de754a734e8ec. Resources: {'instances', 'cores', 'ram'} {{(pid=118302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:10:33.647408 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-6bca52e1-54f6-46cd-8318-59ae308c3158 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Going to run 1 instances... {{(pid=118302) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 19:10:33.649820 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-6bca52e1-54f6-46cd-8318-59ae308c3158 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: 48911604-e8be-4ada-b8aa-e9468ea89514] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0b6be242-215e-4886-a0d2-b8d5f8ca623e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 19:10:33.837135 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-6bca52e1-54f6-46cd-8318-59ae308c3158 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.013654 Aug 03 19:10:33.838525 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 245/496] 10.222.0.77 () {60 vars in 1147 bytes} [Wed Aug 3 19:10:32 2022] POST /compute/v2.1/servers => generated 400 bytes in 1016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 19:10:33.852349 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-4d55ec84-6d00-4edb-98df-8f04ac7a2e52 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:33.852954 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-4d55ec84-6d00-4edb-98df-8f04ac7a2e52 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: 48911604-e8be-4ada-b8aa-e9468ea89514] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:33.951312 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-4d55ec84-6d00-4edb-98df-8f04ac7a2e52 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:33.959076 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-4d55ec84-6d00-4edb-98df-8f04ac7a2e52 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514" status: 200 len: 1236 microversion: 2.1 time: 0.112366 Aug 03 19:10:33.959658 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 252/497] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:33 2022] GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514 => generated 1236 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:34.516385 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-aa530387-e30c-4d23-846f-90c22db6f166 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:34.517303 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-aa530387-e30c-4d23-846f-90c22db6f166 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:34.524309 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-aa530387-e30c-4d23-846f-90c22db6f166 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:34.524763 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-aa530387-e30c-4d23-846f-90c22db6f166 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:34.525608 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-aa530387-e30c-4d23-846f-90c22db6f166 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:34.526045 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-aa530387-e30c-4d23-846f-90c22db6f166 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:34.717888 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-aa530387-e30c-4d23-846f-90c22db6f166 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:34.726661 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-aa530387-e30c-4d23-846f-90c22db6f166 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1568 microversion: 2.1 time: 0.214926 Aug 03 19:10:34.727281 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 246/498] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:34 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1568 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:34.980190 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-5aafb592-bf8a-4927-a94d-c57f8dc07f54 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:34.980743 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-5aafb592-bf8a-4927-a94d-c57f8dc07f54 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: 48911604-e8be-4ada-b8aa-e9468ea89514] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:35.043941 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-5aafb592-bf8a-4927-a94d-c57f8dc07f54 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:35.051438 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-5aafb592-bf8a-4927-a94d-c57f8dc07f54 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514" status: 200 len: 1236 microversion: 2.1 time: 0.075102 Aug 03 19:10:35.052001 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 253/499] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:34 2022] GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514 => generated 1236 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:35.756671 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-0784e1c0-6fac-44e1-b0c2-98d93c058e04 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:35.757354 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-0784e1c0-6fac-44e1-b0c2-98d93c058e04 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:35.759855 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:10:35.774356 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0784e1c0-6fac-44e1-b0c2-98d93c058e04 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:35.774804 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0784e1c0-6fac-44e1-b0c2-98d93c058e04 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:35.775611 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0784e1c0-6fac-44e1-b0c2-98d93c058e04 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:35.776043 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0784e1c0-6fac-44e1-b0c2-98d93c058e04 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:35.918148 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-0784e1c0-6fac-44e1-b0c2-98d93c058e04 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:35.926789 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-0784e1c0-6fac-44e1-b0c2-98d93c058e04 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1568 microversion: 2.1 time: 0.173986 Aug 03 19:10:35.927795 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 247/500] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:35 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:36.080074 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-dfab4d72-7640-4bdd-9441-9a0c6de2b62e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:36.081684 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-dfab4d72-7640-4bdd-9441-9a0c6de2b62e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: 48911604-e8be-4ada-b8aa-e9468ea89514] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:36.089158 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-dfab4d72-7640-4bdd-9441-9a0c6de2b62e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:36.089606 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-dfab4d72-7640-4bdd-9441-9a0c6de2b62e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:36.090984 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-dfab4d72-7640-4bdd-9441-9a0c6de2b62e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:36.090984 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-dfab4d72-7640-4bdd-9441-9a0c6de2b62e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:36.255209 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-dfab4d72-7640-4bdd-9441-9a0c6de2b62e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:36.266680 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-dfab4d72-7640-4bdd-9441-9a0c6de2b62e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514" status: 200 len: 1232 microversion: 2.1 time: 0.196720 Aug 03 19:10:36.267025 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 254/501] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:36 2022] GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514 => generated 1232 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:36.949305 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-ad78f99c-a3c7-43aa-b067-b13fe164eb61 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:36.950114 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-ad78f99c-a3c7-43aa-b067-b13fe164eb61 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:36.957408 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ad78f99c-a3c7-43aa-b067-b13fe164eb61 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:36.957851 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ad78f99c-a3c7-43aa-b067-b13fe164eb61 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:36.958783 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ad78f99c-a3c7-43aa-b067-b13fe164eb61 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:36.959242 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ad78f99c-a3c7-43aa-b067-b13fe164eb61 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:37.112401 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-ad78f99c-a3c7-43aa-b067-b13fe164eb61 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:37.121871 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-ad78f99c-a3c7-43aa-b067-b13fe164eb61 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1568 microversion: 2.1 time: 0.176748 Aug 03 19:10:37.123146 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 248/502] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:36 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:37.289602 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-b3146a55-d6a9-495c-89c0-dab11d941f4c tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:37.290878 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-b3146a55-d6a9-495c-89c0-dab11d941f4c tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: 48911604-e8be-4ada-b8aa-e9468ea89514] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:37.298439 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b3146a55-d6a9-495c-89c0-dab11d941f4c tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:37.299295 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b3146a55-d6a9-495c-89c0-dab11d941f4c tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:37.300337 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b3146a55-d6a9-495c-89c0-dab11d941f4c tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:37.301136 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b3146a55-d6a9-495c-89c0-dab11d941f4c tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:37.407925 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-b3146a55-d6a9-495c-89c0-dab11d941f4c tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:37.419715 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-b3146a55-d6a9-495c-89c0-dab11d941f4c tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514" status: 200 len: 1296 microversion: 2.1 time: 0.134487 Aug 03 19:10:37.438540 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 255/503] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:37 2022] GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514 => generated 1296 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:38.159294 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-91615ea8-a935-441c-9849-fbebe94b6dff tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:38.162993 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-91615ea8-a935-441c-9849-fbebe94b6dff tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:38.169073 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-91615ea8-a935-441c-9849-fbebe94b6dff tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:38.169516 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-91615ea8-a935-441c-9849-fbebe94b6dff tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:38.170446 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-91615ea8-a935-441c-9849-fbebe94b6dff tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:38.170881 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-91615ea8-a935-441c-9849-fbebe94b6dff tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:38.449795 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-8b2531ac-e6db-4ef6-915c-671bcc7e5663 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:38.451623 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-8b2531ac-e6db-4ef6-915c-671bcc7e5663 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: 48911604-e8be-4ada-b8aa-e9468ea89514] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:38.462915 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8b2531ac-e6db-4ef6-915c-671bcc7e5663 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:38.464010 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8b2531ac-e6db-4ef6-915c-671bcc7e5663 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:38.465157 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8b2531ac-e6db-4ef6-915c-671bcc7e5663 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:38.467533 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8b2531ac-e6db-4ef6-915c-671bcc7e5663 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:38.747777 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-91615ea8-a935-441c-9849-fbebe94b6dff tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:38.757566 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-91615ea8-a935-441c-9849-fbebe94b6dff tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1568 microversion: 2.1 time: 0.603495 Aug 03 19:10:38.758153 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 249/504] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:38 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1568 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:38.772541 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-8b2531ac-e6db-4ef6-915c-671bcc7e5663 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:38.784117 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-8b2531ac-e6db-4ef6-915c-671bcc7e5663 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514" status: 200 len: 1360 microversion: 2.1 time: 0.341945 Aug 03 19:10:38.784647 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 256/505] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:38 2022] GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514 => generated 1360 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:10:39.284703 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-911339ca-42e3-4f49-8f7e-6f13e285dea6 req-5c98974f-3968-44b1-84c7-fda46a1669be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48911604-e8be-4ada-b8aa-e9468ea89514", "tag": "d3a549b7-a15c-44c7-b252-5e841bc23c57"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:10:39.305870 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-911339ca-42e3-4f49-8f7e-6f13e285dea6 req-5c98974f-3968-44b1-84c7-fda46a1669be service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:39.306894 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-911339ca-42e3-4f49-8f7e-6f13e285dea6 req-5c98974f-3968-44b1-84c7-fda46a1669be service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:39.321551 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-911339ca-42e3-4f49-8f7e-6f13e285dea6 req-5c98974f-3968-44b1-84c7-fda46a1669be service nova] Creating event network-changed:d3a549b7-a15c-44c7-b252-5e841bc23c57 for instance 48911604-e8be-4ada-b8aa-e9468ea89514 on hv-cinder-85202 Aug 03 19:10:39.328702 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-911339ca-42e3-4f49-8f7e-6f13e285dea6 req-5c98974f-3968-44b1-84c7-fda46a1669be service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047189 Aug 03 19:10:39.330109 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 250/506] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:10:39.782601 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-fe9eb902-eace-4d2e-8860-ceb49566dfd6 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:39.784972 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-fe9eb902-eace-4d2e-8860-ceb49566dfd6 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:39.793477 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fe9eb902-eace-4d2e-8860-ceb49566dfd6 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:39.794383 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fe9eb902-eace-4d2e-8860-ceb49566dfd6 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:39.795773 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fe9eb902-eace-4d2e-8860-ceb49566dfd6 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:39.797948 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fe9eb902-eace-4d2e-8860-ceb49566dfd6 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:39.811273 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-39a2a8b3-bc31-4f66-b063-70df117c0a50 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:39.812193 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-39a2a8b3-bc31-4f66-b063-70df117c0a50 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: 48911604-e8be-4ada-b8aa-e9468ea89514] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:39.842840 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-39a2a8b3-bc31-4f66-b063-70df117c0a50 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:39.850922 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-39a2a8b3-bc31-4f66-b063-70df117c0a50 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:39.852011 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-39a2a8b3-bc31-4f66-b063-70df117c0a50 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:39.853864 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-39a2a8b3-bc31-4f66-b063-70df117c0a50 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:40.192737 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-fe9eb902-eace-4d2e-8860-ceb49566dfd6 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:40.200624 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-fe9eb902-eace-4d2e-8860-ceb49566dfd6 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1568 microversion: 2.1 time: 0.423250 Aug 03 19:10:40.209978 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 257/507] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:39 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1568 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:40.232173 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-39a2a8b3-bc31-4f66-b063-70df117c0a50 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:40.241788 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-39a2a8b3-bc31-4f66-b063-70df117c0a50 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514" status: 200 len: 1360 microversion: 2.1 time: 0.436579 Aug 03 19:10:40.251261 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 251/508] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:39 2022] GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514 => generated 1360 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:10:41.222930 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-9105a0b2-6eeb-4b76-8ec3-50c083d154f0 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:41.223618 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-9105a0b2-6eeb-4b76-8ec3-50c083d154f0 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:41.230798 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9105a0b2-6eeb-4b76-8ec3-50c083d154f0 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:41.232207 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9105a0b2-6eeb-4b76-8ec3-50c083d154f0 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:41.232383 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9105a0b2-6eeb-4b76-8ec3-50c083d154f0 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:41.232663 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9105a0b2-6eeb-4b76-8ec3-50c083d154f0 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:41.278189 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-96359b24-3098-429e-9358-09528031e61e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Action: 'create', calling method: .version_select at 0x7f4786279160>, body: {"keypair": {"name": "tempest-keypair-933445005", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGv5QofqxK8hU4jLLuyuHvvA4DBvcOPm1C56VraLWQLQhUTDVT8B/S9dwzC1698YXsxJz/7CwJFdmJnO45K7ozfFH6e9yigXoI0q5RUlndza4UUPk7EHSkfhsGHUnk+rhg=="}} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:10:41.290815 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.quota [None req-96359b24-3098-429e-9358-09528031e61e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Getting quotas for project fb9177b6619c48e38c20abcda2ebadd4. Resources: {'key_pairs'} {{(pid=118303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:10:41.294468 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.quota [None req-96359b24-3098-429e-9358-09528031e61e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Getting quotas for user 3ad3e2057063434a8938a6e1309782c4 and project fb9177b6619c48e38c20abcda2ebadd4. Resources: {'key_pairs'} {{(pid=118303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:10:41.401188 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-9105a0b2-6eeb-4b76-8ec3-50c083d154f0 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:41.403587 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-96359b24-3098-429e-9358-09528031e61e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.264231 Aug 03 19:10:41.404186 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 258/509] 10.222.0.77 () {62 vars in 1200 bytes} [Wed Aug 3 19:10:41 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 266 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 03 19:10:41.410807 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-473a1ff1-8c17-45e1-88b1-07403e4c4ea0 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:41.411824 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-9105a0b2-6eeb-4b76-8ec3-50c083d154f0 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1568 microversion: 2.1 time: 0.191806 Aug 03 19:10:41.411824 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 252/510] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:41 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1568 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:10:41.413964 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-473a1ff1-8c17-45e1-88b1-07403e4c4ea0 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: 48911604-e8be-4ada-b8aa-e9468ea89514] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:41.429083 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-473a1ff1-8c17-45e1-88b1-07403e4c4ea0 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:41.429614 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-473a1ff1-8c17-45e1-88b1-07403e4c4ea0 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:41.430457 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-473a1ff1-8c17-45e1-88b1-07403e4c4ea0 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:41.430981 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-473a1ff1-8c17-45e1-88b1-07403e4c4ea0 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:41.572061 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-473a1ff1-8c17-45e1-88b1-07403e4c4ea0 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:41.580507 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-473a1ff1-8c17-45e1-88b1-07403e4c4ea0 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514" status: 200 len: 1360 microversion: 2.1 time: 0.175346 Aug 03 19:10:41.581069 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 259/511] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:41 2022] GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514 => generated 1360 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:42.432000 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-22fb582d-5bae-410d-9a3a-967347c6c11a tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:42.432541 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-22fb582d-5bae-410d-9a3a-967347c6c11a tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:42.439816 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-22fb582d-5bae-410d-9a3a-967347c6c11a tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:42.440341 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-22fb582d-5bae-410d-9a3a-967347c6c11a tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:42.441199 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-22fb582d-5bae-410d-9a3a-967347c6c11a tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:42.441713 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-22fb582d-5bae-410d-9a3a-967347c6c11a tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:42.602175 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-c72a3ded-0657-4e08-93cb-cc5315f9cd7b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:42.603230 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-22fb582d-5bae-410d-9a3a-967347c6c11a tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:42.603849 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-c72a3ded-0657-4e08-93cb-cc5315f9cd7b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: 48911604-e8be-4ada-b8aa-e9468ea89514] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:42.611043 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c72a3ded-0657-4e08-93cb-cc5315f9cd7b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:42.611641 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-22fb582d-5bae-410d-9a3a-967347c6c11a tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1568 microversion: 2.1 time: 0.183516 Aug 03 19:10:42.611885 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c72a3ded-0657-4e08-93cb-cc5315f9cd7b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:42.612236 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 253/512] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:42 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:42.613066 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c72a3ded-0657-4e08-93cb-cc5315f9cd7b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:42.613788 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c72a3ded-0657-4e08-93cb-cc5315f9cd7b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:42.761333 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-c72a3ded-0657-4e08-93cb-cc5315f9cd7b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:42.769837 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-c72a3ded-0657-4e08-93cb-cc5315f9cd7b tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514" status: 200 len: 1360 microversion: 2.1 time: 0.172088 Aug 03 19:10:42.770537 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 260/513] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:42 2022] GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514 => generated 1360 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:10:43.634004 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-27570601-828d-45e9-bf39-abc72f7b0ea2 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:43.635309 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-27570601-828d-45e9-bf39-abc72f7b0ea2 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:43.643432 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell0:SELECT=2 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:10:43.644279 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell0:SELECT=6 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:10:43.646711 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-27570601-828d-45e9-bf39-abc72f7b0ea2 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:43.647546 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-27570601-828d-45e9-bf39-abc72f7b0ea2 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:43.648910 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-27570601-828d-45e9-bf39-abc72f7b0ea2 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:43.649534 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-27570601-828d-45e9-bf39-abc72f7b0ea2 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:43.792177 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-9cf485d1-21af-4f0d-a3c8-e268a602ba9e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:43.793624 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-9cf485d1-21af-4f0d-a3c8-e268a602ba9e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: 48911604-e8be-4ada-b8aa-e9468ea89514] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:43.804702 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9cf485d1-21af-4f0d-a3c8-e268a602ba9e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:43.805759 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9cf485d1-21af-4f0d-a3c8-e268a602ba9e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:43.807762 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9cf485d1-21af-4f0d-a3c8-e268a602ba9e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:43.819202 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9cf485d1-21af-4f0d-a3c8-e268a602ba9e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:43.888565 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-27570601-828d-45e9-bf39-abc72f7b0ea2 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:43.898097 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-27570601-828d-45e9-bf39-abc72f7b0ea2 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1568 microversion: 2.1 time: 0.268483 Aug 03 19:10:43.899006 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 254/514] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:43 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1568 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:44.067092 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-9cf485d1-21af-4f0d-a3c8-e268a602ba9e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:44.079241 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-9cf485d1-21af-4f0d-a3c8-e268a602ba9e tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514" status: 200 len: 1360 microversion: 2.1 time: 0.291361 Aug 03 19:10:44.080617 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 261/515] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:43 2022] GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514 => generated 1360 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:44.525464 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-d60ea557-45c9-4585-883c-8d3298a47b7c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1322571132", "imageRef": "0b6be242-215e-4886-a0d2-b8d5f8ca623e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "16f9ea0d-a806-47ec-9430-fa71c1c46ba2"}], "security_groups": [{"name": "tempest-securitygroup--728070009"}], "key_name": "tempest-keypair-933445005", "user_data": "}} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:10:44.639803 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.network.neutron [None req-d60ea557-45c9-4585-883c-8d3298a47b7c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] validate_networks() for [('16f9ea0d-a806-47ec-9430-fa71c1c46ba2', None, None, None, None, None)] {{(pid=118302) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 19:10:44.922494 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-cc9c7e5e-02f5-4aa5-bd75-8e7638e57e35 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:44.923564 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-cc9c7e5e-02f5-4aa5-bd75-8e7638e57e35 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:44.930833 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cc9c7e5e-02f5-4aa5-bd75-8e7638e57e35 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:44.931553 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cc9c7e5e-02f5-4aa5-bd75-8e7638e57e35 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:44.946911 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cc9c7e5e-02f5-4aa5-bd75-8e7638e57e35 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:44.946911 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cc9c7e5e-02f5-4aa5-bd75-8e7638e57e35 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:45.108371 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-d60ea557-45c9-4585-883c-8d3298a47b7c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Flavor limits 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 19:10:45.108908 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-d60ea557-45c9-4585-883c-8d3298a47b7c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Image limits 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 19:10:45.109536 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-d60ea557-45c9-4585-883c-8d3298a47b7c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Flavor pref 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 19:10:45.110093 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-d60ea557-45c9-4585-883c-8d3298a47b7c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Image pref 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 19:10:45.111468 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-d60ea557-45c9-4585-883c-8d3298a47b7c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 19:10:45.121243 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d60ea557-45c9-4585-883c-8d3298a47b7c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:45.125403 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d60ea557-45c9-4585-883c-8d3298a47b7c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:45.125403 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d60ea557-45c9-4585-883c-8d3298a47b7c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:45.125403 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d60ea557-45c9-4585-883c-8d3298a47b7c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:45.134270 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-cc9c7e5e-02f5-4aa5-bd75-8e7638e57e35 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:45.141680 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.quota [None req-d60ea557-45c9-4585-883c-8d3298a47b7c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Getting quotas for project fb9177b6619c48e38c20abcda2ebadd4. Resources: {'instances', 'cores', 'ram'} {{(pid=118302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:10:45.142729 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-cc9c7e5e-02f5-4aa5-bd75-8e7638e57e35 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1568 microversion: 2.1 time: 0.226298 Aug 03 19:10:45.143361 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 262/516] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:44 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1568 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:10:45.145921 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.quota [None req-d60ea557-45c9-4585-883c-8d3298a47b7c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Getting quotas for user 3ad3e2057063434a8938a6e1309782c4 and project fb9177b6619c48e38c20abcda2ebadd4. Resources: {'instances', 'cores', 'ram'} {{(pid=118302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:10:45.147860 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-df6695be-574b-474c-90cc-8ee2f87da673 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:45.148695 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-df6695be-574b-474c-90cc-8ee2f87da673 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: 48911604-e8be-4ada-b8aa-e9468ea89514] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:45.154866 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-df6695be-574b-474c-90cc-8ee2f87da673 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:45.155353 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-df6695be-574b-474c-90cc-8ee2f87da673 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:45.156299 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-df6695be-574b-474c-90cc-8ee2f87da673 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:45.156734 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-df6695be-574b-474c-90cc-8ee2f87da673 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:45.158294 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-d60ea557-45c9-4585-883c-8d3298a47b7c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Going to run 1 instances... {{(pid=118302) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 19:10:45.160609 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-d60ea557-45c9-4585-883c-8d3298a47b7c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0b6be242-215e-4886-a0d2-b8d5f8ca623e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 19:10:45.299566 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-df6695be-574b-474c-90cc-8ee2f87da673 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:45.317936 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-df6695be-574b-474c-90cc-8ee2f87da673 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514" status: 200 len: 1360 microversion: 2.1 time: 0.162687 Aug 03 19:10:45.317936 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 263/517] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:45 2022] GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514 => generated 1360 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:45.353254 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-d60ea557-45c9-4585-883c-8d3298a47b7c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.832015 Aug 03 19:10:45.353910 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 255/518] 10.222.0.77 () {62 vars in 1188 bytes} [Wed Aug 3 19:10:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 833 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 03 19:10:45.365344 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-ecdc3d68-1821-4e37-95b0-698793a0ab24 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:45.365943 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-ecdc3d68-1821-4e37-95b0-698793a0ab24 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:45.427092 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-ecdc3d68-1821-4e37-95b0-698793a0ab24 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:45.434865 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-ecdc3d68-1821-4e37-95b0-698793a0ab24 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:45.436804 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-ecdc3d68-1821-4e37-95b0-698793a0ab24 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:45.438390 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-ecdc3d68-1821-4e37-95b0-698793a0ab24 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1281 microversion: 2.20 time: 0.076783 Aug 03 19:10:45.439022 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 264/519] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:10:45 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1281 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:10:46.165133 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-9538ad94-acec-4204-90df-abc3de0e076c tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:46.165732 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-9538ad94-acec-4204-90df-abc3de0e076c tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:46.172881 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9538ad94-acec-4204-90df-abc3de0e076c tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:46.173787 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9538ad94-acec-4204-90df-abc3de0e076c tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:46.174588 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9538ad94-acec-4204-90df-abc3de0e076c tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:46.175070 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9538ad94-acec-4204-90df-abc3de0e076c tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:46.315820 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-9538ad94-acec-4204-90df-abc3de0e076c tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:46.327797 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-9538ad94-acec-4204-90df-abc3de0e076c tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1568 microversion: 2.1 time: 0.163231 Aug 03 19:10:46.328893 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 256/520] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:46 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:46.329417 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-c4c37729-4237-4bf4-a05f-ec27534f1aa7 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:46.330041 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-c4c37729-4237-4bf4-a05f-ec27534f1aa7 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: 48911604-e8be-4ada-b8aa-e9468ea89514] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:46.337693 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c4c37729-4237-4bf4-a05f-ec27534f1aa7 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:46.338144 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c4c37729-4237-4bf4-a05f-ec27534f1aa7 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:46.339090 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c4c37729-4237-4bf4-a05f-ec27534f1aa7 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:46.339602 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c4c37729-4237-4bf4-a05f-ec27534f1aa7 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:46.463248 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-aaa50a62-41ac-443f-9ddc-e53d1d992407 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:46.464010 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-aaa50a62-41ac-443f-9ddc-e53d1d992407 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:46.486703 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-c4c37729-4237-4bf4-a05f-ec27534f1aa7 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:46.490863 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=100 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:10:46.497841 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-c4c37729-4237-4bf4-a05f-ec27534f1aa7 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514" status: 200 len: 1360 microversion: 2.1 time: 0.172871 Aug 03 19:10:46.502416 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 265/521] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:46 2022] GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514 => generated 1360 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:46.524071 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-aaa50a62-41ac-443f-9ddc-e53d1d992407 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:46.531931 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-aaa50a62-41ac-443f-9ddc-e53d1d992407 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:46.533518 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-aaa50a62-41ac-443f-9ddc-e53d1d992407 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:46.534721 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-aaa50a62-41ac-443f-9ddc-e53d1d992407 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1281 microversion: 2.20 time: 0.076846 Aug 03 19:10:46.535287 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 257/522] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:10:46 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1281 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:10:47.275886 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [req-9fc31075-8e1e-4392-a76f-32921a29e506 req-1d8f79b2-ff53-4c65-a088-ed9ca8aaef27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48911604-e8be-4ada-b8aa-e9468ea89514", "name": "network-vif-plugged", "status": "completed", "tag": "d3a549b7-a15c-44c7-b252-5e841bc23c57"}]} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:10:47.286241 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-9fc31075-8e1e-4392-a76f-32921a29e506 req-1d8f79b2-ff53-4c65-a088-ed9ca8aaef27 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:47.286686 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-9fc31075-8e1e-4392-a76f-32921a29e506 req-1d8f79b2-ff53-4c65-a088-ed9ca8aaef27 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:47.298240 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.compute.server_external_events [req-9fc31075-8e1e-4392-a76f-32921a29e506 req-1d8f79b2-ff53-4c65-a088-ed9ca8aaef27 service nova] Creating event network-vif-plugged:d3a549b7-a15c-44c7-b252-5e841bc23c57 for instance 48911604-e8be-4ada-b8aa-e9468ea89514 on hv-cinder-85202 Aug 03 19:10:47.303299 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [req-9fc31075-8e1e-4392-a76f-32921a29e506 req-1d8f79b2-ff53-4c65-a088-ed9ca8aaef27 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091260 Aug 03 19:10:47.303873 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 266/523] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:10:47.355498 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-770d21f0-6622-4b84-81ce-ef2c15ce5db6 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:47.356117 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-770d21f0-6622-4b84-81ce-ef2c15ce5db6 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:47.363661 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-770d21f0-6622-4b84-81ce-ef2c15ce5db6 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:47.364112 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-770d21f0-6622-4b84-81ce-ef2c15ce5db6 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:47.364889 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-770d21f0-6622-4b84-81ce-ef2c15ce5db6 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:47.365524 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-770d21f0-6622-4b84-81ce-ef2c15ce5db6 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:47.511550 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-770d21f0-6622-4b84-81ce-ef2c15ce5db6 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:47.520243 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-770d21f0-6622-4b84-81ce-ef2c15ce5db6 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1509 microversion: 2.1 time: 0.169061 Aug 03 19:10:47.527511 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 258/524] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:47 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:47.529019 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-f9c9703e-b369-4fcc-919d-b71613398b0a tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:47.529907 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-f9c9703e-b369-4fcc-919d-b71613398b0a tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: 48911604-e8be-4ada-b8aa-e9468ea89514] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:47.538104 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f9c9703e-b369-4fcc-919d-b71613398b0a tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:47.538632 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f9c9703e-b369-4fcc-919d-b71613398b0a tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:47.539450 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f9c9703e-b369-4fcc-919d-b71613398b0a tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:47.539885 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f9c9703e-b369-4fcc-919d-b71613398b0a tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:47.543974 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-113f21c5-bfe3-49fb-ab1c-52e7a87ea44c tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:10:47.544576 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-113f21c5-bfe3-49fb-ab1c-52e7a87ea44c tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:47.557066 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-113f21c5-bfe3-49fb-ab1c-52e7a87ea44c tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:47.557635 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-113f21c5-bfe3-49fb-ab1c-52e7a87ea44c tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:47.558492 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-113f21c5-bfe3-49fb-ab1c-52e7a87ea44c tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:47.558930 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-113f21c5-bfe3-49fb-ab1c-52e7a87ea44c tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:47.608912 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-113f21c5-bfe3-49fb-ab1c-52e7a87ea44c tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118302) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 03 19:10:47.693768 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-f9c9703e-b369-4fcc-919d-b71613398b0a tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:47.701150 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-f9c9703e-b369-4fcc-919d-b71613398b0a tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514" status: 200 len: 1360 microversion: 2.1 time: 0.185813 Aug 03 19:10:47.701707 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 267/525] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:47 2022] GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514 => generated 1360 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:47.706187 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-fd3022ac-1091-42a3-ac09-e65665ab9ac2 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:47.706784 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-fd3022ac-1091-42a3-ac09-e65665ab9ac2 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:47.712502 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fd3022ac-1091-42a3-ac09-e65665ab9ac2 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:47.712950 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fd3022ac-1091-42a3-ac09-e65665ab9ac2 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:47.713771 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fd3022ac-1091-42a3-ac09-e65665ab9ac2 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:47.714146 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fd3022ac-1091-42a3-ac09-e65665ab9ac2 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:47.787002 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-fd3022ac-1091-42a3-ac09-e65665ab9ac2 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:47.796045 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-fd3022ac-1091-42a3-ac09-e65665ab9ac2 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:47.798552 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-fd3022ac-1091-42a3-ac09-e65665ab9ac2 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:47.799683 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-fd3022ac-1091-42a3-ac09-e65665ab9ac2 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1277 microversion: 2.20 time: 0.097067 Aug 03 19:10:47.800226 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 268/526] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:10:47 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1277 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:10:47.910473 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-667b9e52-ea54-46c3-aadd-2e007edd58d5 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:47.910986 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-667b9e52-ea54-46c3-aadd-2e007edd58d5 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: 483630e6-3fee-46ff-8bd2-5031a27f8696] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:47.917454 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-667b9e52-ea54-46c3-aadd-2e007edd58d5 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:47.917896 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-667b9e52-ea54-46c3-aadd-2e007edd58d5 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:47.918656 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-667b9e52-ea54-46c3-aadd-2e007edd58d5 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:47.919134 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-667b9e52-ea54-46c3-aadd-2e007edd58d5 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:47.944346 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-667b9e52-ea54-46c3-aadd-2e007edd58d5 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: 483630e6-3fee-46ff-8bd2-5031a27f8696] Going to try to terminate instance {{(pid=118303) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 19:10:48.066589 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-113f21c5-bfe3-49fb-ab1c-52e7a87ea44c tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "POST /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207/action" status: 202 len: 0 microversion: 2.1 time: 0.528599 Aug 03 19:10:48.067242 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 259/527] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 3 19:10:47 2022] POST /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207/action => generated 0 bytes in 530 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 19:10:48.076375 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-83385e62-4687-4105-a434-8865a4af6c27 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:48.076983 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-83385e62-4687-4105-a434-8865a4af6c27 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:48.083975 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-83385e62-4687-4105-a434-8865a4af6c27 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:48.084430 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-83385e62-4687-4105-a434-8865a4af6c27 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:48.085676 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-83385e62-4687-4105-a434-8865a4af6c27 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:48.085803 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-83385e62-4687-4105-a434-8865a4af6c27 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:48.090005 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:10:48.229071 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-83385e62-4687-4105-a434-8865a4af6c27 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:48.239575 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-83385e62-4687-4105-a434-8865a4af6c27 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1517 microversion: 2.1 time: 0.164679 Aug 03 19:10:48.239575 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 260/528] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:48 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:10:48.351241 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-667b9e52-ea54-46c3-aadd-2e007edd58d5 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "DELETE /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696" status: 204 len: 0 microversion: 2.1 time: 0.445164 Aug 03 19:10:48.351836 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 269/529] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 3 19:10:47 2022] DELETE /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 19:10:48.360807 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-41d81ffc-b442-4649-836a-33a3cda77dc9 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:48.361477 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-41d81ffc-b442-4649-836a-33a3cda77dc9 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: 483630e6-3fee-46ff-8bd2-5031a27f8696] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:48.368225 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-41d81ffc-b442-4649-836a-33a3cda77dc9 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:48.368672 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-41d81ffc-b442-4649-836a-33a3cda77dc9 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:48.369434 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-41d81ffc-b442-4649-836a-33a3cda77dc9 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:48.369930 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-41d81ffc-b442-4649-836a-33a3cda77dc9 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:48.529078 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-41d81ffc-b442-4649-836a-33a3cda77dc9 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:48.537998 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-41d81ffc-b442-4649-836a-33a3cda77dc9 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696" status: 200 len: 1576 microversion: 2.1 time: 0.181789 Aug 03 19:10:48.538969 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 261/530] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:48 2022] GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696 => generated 1576 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:48.724395 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-ded42e1d-d5a4-4461-8dee-279de9c182b4 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:48.725652 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-ded42e1d-d5a4-4461-8dee-279de9c182b4 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: 48911604-e8be-4ada-b8aa-e9468ea89514] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:48.731700 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ded42e1d-d5a4-4461-8dee-279de9c182b4 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:48.732121 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ded42e1d-d5a4-4461-8dee-279de9c182b4 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:48.732884 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ded42e1d-d5a4-4461-8dee-279de9c182b4 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:48.733316 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ded42e1d-d5a4-4461-8dee-279de9c182b4 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:48.823546 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-683fa4e2-0677-42ea-81bd-c1097eaa17ec tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:48.824175 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-683fa4e2-0677-42ea-81bd-c1097eaa17ec tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:48.830436 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-683fa4e2-0677-42ea-81bd-c1097eaa17ec tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:48.830884 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-683fa4e2-0677-42ea-81bd-c1097eaa17ec tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:48.831786 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-683fa4e2-0677-42ea-81bd-c1097eaa17ec tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:48.832297 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-683fa4e2-0677-42ea-81bd-c1097eaa17ec tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:48.882860 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-ded42e1d-d5a4-4461-8dee-279de9c182b4 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:48.891154 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-ded42e1d-d5a4-4461-8dee-279de9c182b4 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514" status: 200 len: 1360 microversion: 2.1 time: 0.171016 Aug 03 19:10:48.903270 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 270/531] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:48 2022] GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514 => generated 1360 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:48.904150 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-683fa4e2-0677-42ea-81bd-c1097eaa17ec tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:48.909922 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-683fa4e2-0677-42ea-81bd-c1097eaa17ec tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:48.915197 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-683fa4e2-0677-42ea-81bd-c1097eaa17ec tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:48.915197 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-683fa4e2-0677-42ea-81bd-c1097eaa17ec tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1333 microversion: 2.20 time: 0.093258 Aug 03 19:10:48.915197 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 262/532] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:10:48 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1333 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 19:10:49.261597 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-097e0683-5a63-48e6-b43d-bc97289d44bd tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:49.262213 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-097e0683-5a63-48e6-b43d-bc97289d44bd tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:49.269690 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-097e0683-5a63-48e6-b43d-bc97289d44bd tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:49.270146 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-097e0683-5a63-48e6-b43d-bc97289d44bd tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:49.270972 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-097e0683-5a63-48e6-b43d-bc97289d44bd tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:49.271426 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-097e0683-5a63-48e6-b43d-bc97289d44bd tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:49.318248 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-2ed153d3-04ee-40e9-9c2c-8d470d835ecc req-6fdfedd9-4ed2-4fd3-96cc-d5c3aa17ca2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c5a48c7-6f8c-4016-9bdc-257578d6c207", "name": "network-vif-unplugged", "status": "completed", "tag": "a29c7b71-aaab-4c8a-afd0-f196f7f95847"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:10:49.329746 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-2ed153d3-04ee-40e9-9c2c-8d470d835ecc req-6fdfedd9-4ed2-4fd3-96cc-d5c3aa17ca2d service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:49.330186 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-2ed153d3-04ee-40e9-9c2c-8d470d835ecc req-6fdfedd9-4ed2-4fd3-96cc-d5c3aa17ca2d service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:49.342114 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.compute.server_external_events [req-2ed153d3-04ee-40e9-9c2c-8d470d835ecc req-6fdfedd9-4ed2-4fd3-96cc-d5c3aa17ca2d service nova] Unable to find a host for instance 2c5a48c7-6f8c-4016-9bdc-257578d6c207. Dropping event network-vif-unplugged {{(pid=118302) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 03 19:10:49.343195 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-2ed153d3-04ee-40e9-9c2c-8d470d835ecc req-6fdfedd9-4ed2-4fd3-96cc-d5c3aa17ca2d service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028646 Aug 03 19:10:49.344158 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 263/533] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 03 19:10:49.434082 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-097e0683-5a63-48e6-b43d-bc97289d44bd tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:49.442493 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-097e0683-5a63-48e6-b43d-bc97289d44bd tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1517 microversion: 2.1 time: 0.184819 Aug 03 19:10:49.443269 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 271/534] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:49 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1517 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:49.561512 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-841bc089-0f7e-4c9a-900e-5fca14537c99 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:49.562095 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-841bc089-0f7e-4c9a-900e-5fca14537c99 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: 483630e6-3fee-46ff-8bd2-5031a27f8696] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:49.569126 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-841bc089-0f7e-4c9a-900e-5fca14537c99 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:49.569579 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-841bc089-0f7e-4c9a-900e-5fca14537c99 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:49.570361 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-841bc089-0f7e-4c9a-900e-5fca14537c99 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:49.570885 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-841bc089-0f7e-4c9a-900e-5fca14537c99 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:49.718731 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-841bc089-0f7e-4c9a-900e-5fca14537c99 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:49.727682 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-841bc089-0f7e-4c9a-900e-5fca14537c99 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696" status: 200 len: 1576 microversion: 2.1 time: 0.170055 Aug 03 19:10:49.728269 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 264/535] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:49 2022] GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696 => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:49.916163 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-fe62187f-c071-43e8-8dee-eecc3ae22589 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:49.916959 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-fe62187f-c071-43e8-8dee-eecc3ae22589 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: 48911604-e8be-4ada-b8aa-e9468ea89514] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:49.924850 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fe62187f-c071-43e8-8dee-eecc3ae22589 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:49.925326 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fe62187f-c071-43e8-8dee-eecc3ae22589 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:49.926098 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fe62187f-c071-43e8-8dee-eecc3ae22589 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:49.926532 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fe62187f-c071-43e8-8dee-eecc3ae22589 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:49.935552 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-adc446b8-c576-48cc-a9c4-3062463a8295 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:49.936161 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-adc446b8-c576-48cc-a9c4-3062463a8295 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:49.944301 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-adc446b8-c576-48cc-a9c4-3062463a8295 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:49.944789 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-adc446b8-c576-48cc-a9c4-3062463a8295 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:49.945565 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-adc446b8-c576-48cc-a9c4-3062463a8295 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:49.945993 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-adc446b8-c576-48cc-a9c4-3062463a8295 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:50.053683 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-adc446b8-c576-48cc-a9c4-3062463a8295 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:50.065730 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-adc446b8-c576-48cc-a9c4-3062463a8295 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:50.067364 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-adc446b8-c576-48cc-a9c4-3062463a8295 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:50.068662 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-adc446b8-c576-48cc-a9c4-3062463a8295 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1333 microversion: 2.20 time: 0.137125 Aug 03 19:10:50.069228 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 265/536] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:10:49 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1333 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 19:10:50.132571 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-fe62187f-c071-43e8-8dee-eecc3ae22589 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:50.140632 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-fe62187f-c071-43e8-8dee-eecc3ae22589 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514" status: 200 len: 1360 microversion: 2.1 time: 0.229252 Aug 03 19:10:50.141498 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 272/537] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:49 2022] GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514 => generated 1360 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:50.466353 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-520fc609-13f6-491c-81a5-0288dffe2c4c tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:50.466939 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-520fc609-13f6-491c-81a5-0288dffe2c4c tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:50.474125 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-520fc609-13f6-491c-81a5-0288dffe2c4c tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:50.475961 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-520fc609-13f6-491c-81a5-0288dffe2c4c tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:50.476331 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-520fc609-13f6-491c-81a5-0288dffe2c4c tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:50.478115 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-520fc609-13f6-491c-81a5-0288dffe2c4c tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:50.627206 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-520fc609-13f6-491c-81a5-0288dffe2c4c tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:50.638049 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-520fc609-13f6-491c-81a5-0288dffe2c4c tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1517 microversion: 2.1 time: 0.175792 Aug 03 19:10:50.638628 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 266/538] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:50 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1517 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:50.749231 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-fe34f2f7-8951-4e9a-aa39-406e826ca323 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:50.750139 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-fe34f2f7-8951-4e9a-aa39-406e826ca323 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: 483630e6-3fee-46ff-8bd2-5031a27f8696] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:50.757321 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fe34f2f7-8951-4e9a-aa39-406e826ca323 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:50.757770 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fe34f2f7-8951-4e9a-aa39-406e826ca323 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:50.758538 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fe34f2f7-8951-4e9a-aa39-406e826ca323 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:50.759000 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fe34f2f7-8951-4e9a-aa39-406e826ca323 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:50.918558 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-fe34f2f7-8951-4e9a-aa39-406e826ca323 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:50.926911 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-fe34f2f7-8951-4e9a-aa39-406e826ca323 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696" status: 200 len: 1576 microversion: 2.1 time: 0.181683 Aug 03 19:10:50.927568 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 273/539] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:50 2022] GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696 => generated 1576 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:10:51.091880 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-444b767c-4f87-4b57-82bf-85c19e62ad0d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:51.092653 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-444b767c-4f87-4b57-82bf-85c19e62ad0d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:51.099529 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-444b767c-4f87-4b57-82bf-85c19e62ad0d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:51.099981 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-444b767c-4f87-4b57-82bf-85c19e62ad0d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:51.100760 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-444b767c-4f87-4b57-82bf-85c19e62ad0d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:51.101320 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-444b767c-4f87-4b57-82bf-85c19e62ad0d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:51.162339 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-af93a3c3-26c4-4f16-a52e-28cdd3cbce25 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:51.162981 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-af93a3c3-26c4-4f16-a52e-28cdd3cbce25 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: 48911604-e8be-4ada-b8aa-e9468ea89514] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:51.170246 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-af93a3c3-26c4-4f16-a52e-28cdd3cbce25 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:51.170701 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-af93a3c3-26c4-4f16-a52e-28cdd3cbce25 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:51.171509 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-af93a3c3-26c4-4f16-a52e-28cdd3cbce25 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:51.172305 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-af93a3c3-26c4-4f16-a52e-28cdd3cbce25 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:51.189495 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-444b767c-4f87-4b57-82bf-85c19e62ad0d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:51.202177 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-444b767c-4f87-4b57-82bf-85c19e62ad0d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:51.204696 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-444b767c-4f87-4b57-82bf-85c19e62ad0d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:51.206063 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-444b767c-4f87-4b57-82bf-85c19e62ad0d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1333 microversion: 2.20 time: 0.118220 Aug 03 19:10:51.206805 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 267/540] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:10:51 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1333 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:10:51.378002 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-af93a3c3-26c4-4f16-a52e-28cdd3cbce25 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:51.387352 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-af93a3c3-26c4-4f16-a52e-28cdd3cbce25 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514" status: 200 len: 1546 microversion: 2.1 time: 0.228612 Aug 03 19:10:51.388859 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 274/541] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:51 2022] GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514 => generated 1546 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:10:51.409307 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-e6b6204e-2467-4fbe-a600-3e1d3ef936c3 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:51.409793 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-e6b6204e-2467-4fbe-a600-3e1d3ef936c3 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: 48911604-e8be-4ada-b8aa-e9468ea89514] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:51.416161 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e6b6204e-2467-4fbe-a600-3e1d3ef936c3 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:51.416860 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e6b6204e-2467-4fbe-a600-3e1d3ef936c3 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:51.417808 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e6b6204e-2467-4fbe-a600-3e1d3ef936c3 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:51.418395 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e6b6204e-2467-4fbe-a600-3e1d3ef936c3 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:51.529939 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-e6b6204e-2467-4fbe-a600-3e1d3ef936c3 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.125010 Aug 03 19:10:51.530765 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 268/542] 10.222.0.77 () {58 vars in 1275 bytes} [Wed Aug 3 19:10:51 2022] GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514/os-interface => generated 285 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:10:51.662919 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-12d0885d-6c1f-4525-8b0e-658e294ae347 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:51.665661 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-12d0885d-6c1f-4525-8b0e-658e294ae347 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:51.673644 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-12d0885d-6c1f-4525-8b0e-658e294ae347 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:51.674286 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-12d0885d-6c1f-4525-8b0e-658e294ae347 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:51.675361 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-12d0885d-6c1f-4525-8b0e-658e294ae347 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:51.675818 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-12d0885d-6c1f-4525-8b0e-658e294ae347 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:51.950047 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-9928929d-21e7-4261-9e7f-276da8576c46 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:51.950684 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-9928929d-21e7-4261-9e7f-276da8576c46 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: 483630e6-3fee-46ff-8bd2-5031a27f8696] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:51.958748 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9928929d-21e7-4261-9e7f-276da8576c46 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:51.959624 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9928929d-21e7-4261-9e7f-276da8576c46 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:51.960642 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9928929d-21e7-4261-9e7f-276da8576c46 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:51.961160 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9928929d-21e7-4261-9e7f-276da8576c46 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:52.335480 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-12d0885d-6c1f-4525-8b0e-658e294ae347 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:52.354160 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-12d0885d-6c1f-4525-8b0e-658e294ae347 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1519 microversion: 2.1 time: 0.695514 Aug 03 19:10:52.356805 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 275/543] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:51 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1519 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:52.366272 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-fe0399c0-b2dc-4276-8a52-d703af1aee60 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:52.367424 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-fe0399c0-b2dc-4276-8a52-d703af1aee60 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:52.379596 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fe0399c0-b2dc-4276-8a52-d703af1aee60 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:52.380343 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fe0399c0-b2dc-4276-8a52-d703af1aee60 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:52.381622 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fe0399c0-b2dc-4276-8a52-d703af1aee60 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:52.382371 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fe0399c0-b2dc-4276-8a52-d703af1aee60 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:52.432867 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-9928929d-21e7-4261-9e7f-276da8576c46 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:52.441765 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-9928929d-21e7-4261-9e7f-276da8576c46 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696" status: 200 len: 1576 microversion: 2.1 time: 0.497191 Aug 03 19:10:52.442396 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 269/544] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:51 2022] GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696 => generated 1576 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:10:52.490747 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-fe0399c0-b2dc-4276-8a52-d703af1aee60 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:52.495650 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-fe0399c0-b2dc-4276-8a52-d703af1aee60 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:52.497254 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-fe0399c0-b2dc-4276-8a52-d703af1aee60 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:52.498539 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-fe0399c0-b2dc-4276-8a52-d703af1aee60 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1339 microversion: 2.20 time: 0.140129 Aug 03 19:10:52.499231 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 276/545] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:10:52 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1339 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:10:52.536035 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-e8c8cb95-a9e8-4048-9936-0a2a69aafefb req-cbbac5e1-343e-4a5b-9399-5d5fce76ff25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "483630e6-3fee-46ff-8bd2-5031a27f8696", "name": "network-vif-deleted", "tag": "14e45674-2652-4efa-9368-ed9ccf397690"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:10:52.558094 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-e8c8cb95-a9e8-4048-9936-0a2a69aafefb req-cbbac5e1-343e-4a5b-9399-5d5fce76ff25 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:52.558544 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-e8c8cb95-a9e8-4048-9936-0a2a69aafefb req-cbbac5e1-343e-4a5b-9399-5d5fce76ff25 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:52.584128 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-e8c8cb95-a9e8-4048-9936-0a2a69aafefb req-cbbac5e1-343e-4a5b-9399-5d5fce76ff25 service nova] Creating event network-vif-deleted:14e45674-2652-4efa-9368-ed9ccf397690 for instance 483630e6-3fee-46ff-8bd2-5031a27f8696 on hv-cinder-85202 Aug 03 19:10:52.589879 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-e8c8cb95-a9e8-4048-9936-0a2a69aafefb req-cbbac5e1-343e-4a5b-9399-5d5fce76ff25 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061980 Aug 03 19:10:52.590314 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 270/546] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:10:53.385431 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-88975713-d7d6-4444-9084-0a85fe317076 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:53.394599 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-88975713-d7d6-4444-9084-0a85fe317076 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:53.433972 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-88975713-d7d6-4444-9084-0a85fe317076 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:53.435030 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-88975713-d7d6-4444-9084-0a85fe317076 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:53.447411 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-88975713-d7d6-4444-9084-0a85fe317076 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:53.447880 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-88975713-d7d6-4444-9084-0a85fe317076 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:53.464919 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-d56bd958-2b64-429e-ab20-e329670f21a1 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:53.465764 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-d56bd958-2b64-429e-ab20-e329670f21a1 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: 483630e6-3fee-46ff-8bd2-5031a27f8696] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:53.479061 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d56bd958-2b64-429e-ab20-e329670f21a1 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:53.480190 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d56bd958-2b64-429e-ab20-e329670f21a1 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:53.482041 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d56bd958-2b64-429e-ab20-e329670f21a1 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:53.483249 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d56bd958-2b64-429e-ab20-e329670f21a1 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:53.643851 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-d56bd958-2b64-429e-ab20-e329670f21a1 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:53.656682 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-d56bd958-2b64-429e-ab20-e329670f21a1 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696" status: 200 len: 1225 microversion: 2.1 time: 0.196359 Aug 03 19:10:53.673828 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 271/547] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:53 2022] GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696 => generated 1225 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:10:53.681326 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-18170778-ee5d-4cf4-8303-94d9d2f78fbb tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:53.682344 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-18170778-ee5d-4cf4-8303-94d9d2f78fbb tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:53.692062 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-18170778-ee5d-4cf4-8303-94d9d2f78fbb tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:53.692841 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-18170778-ee5d-4cf4-8303-94d9d2f78fbb tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:53.694166 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-18170778-ee5d-4cf4-8303-94d9d2f78fbb tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:53.695022 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-18170778-ee5d-4cf4-8303-94d9d2f78fbb tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:54.062362 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-88975713-d7d6-4444-9084-0a85fe317076 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:54.071948 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-88975713-d7d6-4444-9084-0a85fe317076 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1575 microversion: 2.1 time: 0.691450 Aug 03 19:10:54.077401 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 277/548] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:53 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1575 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:54.135842 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-18170778-ee5d-4cf4-8303-94d9d2f78fbb tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:54.162187 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-18170778-ee5d-4cf4-8303-94d9d2f78fbb tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:54.166295 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-18170778-ee5d-4cf4-8303-94d9d2f78fbb tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:54.170424 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-18170778-ee5d-4cf4-8303-94d9d2f78fbb tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1406 microversion: 2.20 time: 0.495184 Aug 03 19:10:54.171062 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 272/549] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:10:53 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1406 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:10:54.230760 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [req-e05a4341-54d6-4a46-a792-57393dd028a4 req-c93c6442-abf7-497b-ac2a-253012ae120d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48911604-e8be-4ada-b8aa-e9468ea89514", "tag": "d3a549b7-a15c-44c7-b252-5e841bc23c57"}]} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:10:54.269459 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-e05a4341-54d6-4a46-a792-57393dd028a4 req-c93c6442-abf7-497b-ac2a-253012ae120d service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:54.271008 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-e05a4341-54d6-4a46-a792-57393dd028a4 req-c93c6442-abf7-497b-ac2a-253012ae120d service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:54.306068 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.compute.server_external_events [req-e05a4341-54d6-4a46-a792-57393dd028a4 req-c93c6442-abf7-497b-ac2a-253012ae120d service nova] Creating event network-changed:d3a549b7-a15c-44c7-b252-5e841bc23c57 for instance 48911604-e8be-4ada-b8aa-e9468ea89514 on hv-cinder-85202 Aug 03 19:10:54.320366 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [req-e05a4341-54d6-4a46-a792-57393dd028a4 req-c93c6442-abf7-497b-ac2a-253012ae120d service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102149 Aug 03 19:10:54.320366 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 278/550] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:10:54.687709 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-1d8e76d4-91c8-435b-a031-ad8e610e0919 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:54.688513 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-1d8e76d4-91c8-435b-a031-ad8e610e0919 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: 483630e6-3fee-46ff-8bd2-5031a27f8696] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:54.696412 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1d8e76d4-91c8-435b-a031-ad8e610e0919 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:54.696840 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1d8e76d4-91c8-435b-a031-ad8e610e0919 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:54.697844 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1d8e76d4-91c8-435b-a031-ad8e610e0919 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:54.698279 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1d8e76d4-91c8-435b-a031-ad8e610e0919 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:54.715061 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.wsgi [None req-1d8e76d4-91c8-435b-a031-ad8e610e0919 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] HTTP exception thrown: Instance 483630e6-3fee-46ff-8bd2-5031a27f8696 could not be found. Aug 03 19:10:54.716799 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-1d8e76d4-91c8-435b-a031-ad8e610e0919 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Request method failure captured: Aug 03 19:10:54.716799 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: request: GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696 HTTP/1.1 Aug 03 19:10:54.716799 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept: application/json Aug 03 19:10:54.716799 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept-Encoding: identity Aug 03 19:10:54.716799 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Connection: close Aug 03 19:10:54.716799 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Length: 0 Aug 03 19:10:54.716799 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Type: application/json Aug 03 19:10:54.716799 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Host: 10.222.0.77 Aug 03 19:10:54.716799 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Openstack-System-Scope: None Aug 03 19:10:54.716799 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: User-Agent: python-urllib3/1.26.11 Aug 03 19:10:54.716799 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Auth-Token: gAAAAABi6sdffadQLm_E0CMgfxe8VavQQNtbdEarH7kyUCUjHdvSPyOchPO7DzYV4pw-cc1aAp83qyPjmYENqcVFbn1Zsm30Otk2xeNjKmUa3NN7dYoxj5hOEk5rjmk5HZU01I04OW2Nw6NW3uDOY1FOzqGjBbgVXquzADEZ1oOtmyGixErsioc Aug 03 19:10:54.716799 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Id: None Aug 03 19:10:54.716799 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Name: None Aug 03 19:10:54.716799 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Identity-Status: Confirmed Aug 03 19:10:54.716799 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Is-Admin-Project: True Aug 03 19:10:54.716799 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Id: default Aug 03 19:10:54.716799 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Name: Default Aug 03 19:10:54.716799 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Id: 28d15350ea8f45b490bb080384999f4b Aug 03 19:10:54.716799 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Name: tempest-TestVolumeBootPattern-2001643055 Aug 03 19:10:54.716799 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Role: reader,member Aug 03 19:10:54.716799 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Roles: reader,member Aug 03 19:10:54.719338 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_28d15350ea8f45b490bb080384999f4b", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/28d15350ea8f45b490bb080384999f4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/28d15350ea8f45b490bb080384999f4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/28d15350ea8f45b490bb080384999f4b"}]}] Aug 03 19:10:54.719338 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant: tempest-TestVolumeBootPattern-2001643055 Aug 03 19:10:54.719338 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Id: 28d15350ea8f45b490bb080384999f4b Aug 03 19:10:54.719338 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Name: tempest-TestVolumeBootPattern-2001643055 Aug 03 19:10:54.719338 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User: tempest-TestVolumeBootPattern-2001643055-project Aug 03 19:10:54.719338 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Id: default Aug 03 19:10:54.719338 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Name: Default Aug 03 19:10:54.719338 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Id: 626fe64980ed40d4bbb829c75dc0067c Aug 03 19:10:54.719338 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Name: tempest-TestVolumeBootPattern-2001643055-project Aug 03 19:10:54.719338 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: method: > Aug 03 19:10:54.719338 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: exception: Instance 483630e6-3fee-46ff-8bd2-5031a27f8696 could not be found. Aug 03 19:10:54.719338 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: action_args: {'id': '483630e6-3fee-46ff-8bd2-5031a27f8696'} Aug 03 19:10:54.720517 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:10:54.720517 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:10:54.720517 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:10:54.720517 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:10:54.720517 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:10:54.720517 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:10:54.720517 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:10:54.720517 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:10:54.720517 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:10:54.720517 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:10:54.720517 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 483630e6-3fee-46ff-8bd2-5031a27f8696 could not be found. Aug 03 19:10:54.720517 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:10:54.720517 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:10:54.720517 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:10:54.720517 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:10:54.720517 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:10:54.720517 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:10:54.720517 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:10:54.720517 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:10:54.720517 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:10:54.722763 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:10:54.722763 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:10:54.722763 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:10:54.722763 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:10:54.722763 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:10:54.722763 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:10:54.722763 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:10:54.722763 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 483630e6-3fee-46ff-8bd2-5031a27f8696 could not be found. Aug 03 19:10:54.722763 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:10:54.722763 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:10:54.722763 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:10:54.722763 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:10:54.722763 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:10:54.722763 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:10:54.722763 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:10:54.722763 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:10:54.722763 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 483630e6-3fee-46ff-8bd2-5031a27f8696 could not be found. Aug 03 19:10:54.722763 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:10:54.725175 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-1d8e76d4-91c8-435b-a031-ad8e610e0919 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Returning 404 to user: Instance 483630e6-3fee-46ff-8bd2-5031a27f8696 could not be found. {{(pid=118302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:10:54.725175 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-1d8e76d4-91c8-435b-a031-ad8e610e0919 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696" status: 404 len: 111 microversion: 2.1 time: 0.035927 Aug 03 19:10:54.725175 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 273/551] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:54 2022] GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:10:54.881518 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-0f6c07bb-5ed9-4077-93cf-7cb6ded153e7 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-763830086", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1132387639", "security_groups": [{"name": "tempest-secgroup-smoke-499638857"}], "block_device_mapping_v2": [{"uuid": "7961a1c8-5a96-4c48-9ac9-1226bec7c278", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9ccc48a3-6dd8-4736-87f7-cf1e5f400519"}]}} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:10:55.073901 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.network.neutron [None req-0f6c07bb-5ed9-4077-93cf-7cb6ded153e7 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] validate_networks() for [('9ccc48a3-6dd8-4736-87f7-cf1e5f400519', None, None, None, None, None)] {{(pid=118303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 19:10:55.107871 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-ac16a8c7-1d51-4eaa-8350-483c593be04a tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:55.108597 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-ac16a8c7-1d51-4eaa-8350-483c593be04a tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:55.116134 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ac16a8c7-1d51-4eaa-8350-483c593be04a tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:55.116574 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ac16a8c7-1d51-4eaa-8350-483c593be04a tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:55.117822 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ac16a8c7-1d51-4eaa-8350-483c593be04a tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:55.118592 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ac16a8c7-1d51-4eaa-8350-483c593be04a tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:55.142872 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell0:SELECT=2 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:10:55.434246 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell0:SELECT=14 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:10:55.688915 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-ac16a8c7-1d51-4eaa-8350-483c593be04a tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:55.700710 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-ac16a8c7-1d51-4eaa-8350-483c593be04a tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1575 microversion: 2.1 time: 0.596786 Aug 03 19:10:55.701307 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 274/552] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:55 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1575 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:10:55.722782 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-1fe7c0fd-1613-4fc7-91cf-27b1a654ccfd tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:55.723889 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-1fe7c0fd-1613-4fc7-91cf-27b1a654ccfd tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:55.731116 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1fe7c0fd-1613-4fc7-91cf-27b1a654ccfd tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:55.731816 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1fe7c0fd-1613-4fc7-91cf-27b1a654ccfd tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:55.732597 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1fe7c0fd-1613-4fc7-91cf-27b1a654ccfd tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:55.733040 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1fe7c0fd-1613-4fc7-91cf-27b1a654ccfd tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:56.072149 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-1fe7c0fd-1613-4fc7-91cf-27b1a654ccfd tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:56.081397 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-1fe7c0fd-1613-4fc7-91cf-27b1a654ccfd tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:56.083146 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-1fe7c0fd-1613-4fc7-91cf-27b1a654ccfd tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:56.088642 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-1fe7c0fd-1613-4fc7-91cf-27b1a654ccfd tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1406 microversion: 2.20 time: 0.368131 Aug 03 19:10:56.088642 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 275/553] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:10:55 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1406 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:10:56.252531 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-0f6c07bb-5ed9-4077-93cf-7cb6ded153e7 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Flavor limits 0:0:0 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 19:10:56.253302 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-0f6c07bb-5ed9-4077-93cf-7cb6ded153e7 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Image limits 0:0:0 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 19:10:56.254180 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-0f6c07bb-5ed9-4077-93cf-7cb6ded153e7 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Flavor pref 0:0:0 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 19:10:56.254972 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-0f6c07bb-5ed9-4077-93cf-7cb6ded153e7 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Image pref 0:0:0 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 19:10:56.255714 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-0f6c07bb-5ed9-4077-93cf-7cb6ded153e7 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 19:10:56.268068 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0f6c07bb-5ed9-4077-93cf-7cb6ded153e7 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:56.268511 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0f6c07bb-5ed9-4077-93cf-7cb6ded153e7 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:56.269305 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0f6c07bb-5ed9-4077-93cf-7cb6ded153e7 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:56.269743 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0f6c07bb-5ed9-4077-93cf-7cb6ded153e7 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:56.287672 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.quota [None req-0f6c07bb-5ed9-4077-93cf-7cb6ded153e7 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Getting quotas for project 28d15350ea8f45b490bb080384999f4b. Resources: {'instances', 'cores', 'ram'} {{(pid=118303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:10:56.292175 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.quota [None req-0f6c07bb-5ed9-4077-93cf-7cb6ded153e7 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Getting quotas for user 626fe64980ed40d4bbb829c75dc0067c and project 28d15350ea8f45b490bb080384999f4b. Resources: {'instances', 'cores', 'ram'} {{(pid=118303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:10:56.352754 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-b0d3a931-aea5-40b5-9938-df94c8bb48cf req-c453b9ad-de1d-4d2f-847a-c813f8ed4543 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e21c8ef-c172-41cd-806e-f69f81116b6a", "tag": "5bac2969-4e88-4008-93e1-3408ccc91cbb"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:10:56.364412 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-b0d3a931-aea5-40b5-9938-df94c8bb48cf req-c453b9ad-de1d-4d2f-847a-c813f8ed4543 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:56.365212 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-b0d3a931-aea5-40b5-9938-df94c8bb48cf req-c453b9ad-de1d-4d2f-847a-c813f8ed4543 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:56.380671 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-b0d3a931-aea5-40b5-9938-df94c8bb48cf req-c453b9ad-de1d-4d2f-847a-c813f8ed4543 service nova] Creating event network-changed:5bac2969-4e88-4008-93e1-3408ccc91cbb for instance 2e21c8ef-c172-41cd-806e-f69f81116b6a on hv-cinder-85202 Aug 03 19:10:56.386463 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-b0d3a931-aea5-40b5-9938-df94c8bb48cf req-c453b9ad-de1d-4d2f-847a-c813f8ed4543 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038026 Aug 03 19:10:56.387609 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 276/554] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 19:10:56.392607 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-0f6c07bb-5ed9-4077-93cf-7cb6ded153e7 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Going to run 1 instances... {{(pid=118303) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 19:10:56.395320 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-0f6c07bb-5ed9-4077-93cf-7cb6ded153e7 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c33c4d48-ab10-4a55-aca5-b86ad860a568] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7961a1c8-5a96-4c48-9ac9-1226bec7c278',volume_size=None,volume_type=None)] {{(pid=118303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 19:10:56.728536 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-c4928155-30b5-4d71-ad58-951ff49d7d93 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:56.729301 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-c4928155-30b5-4d71-ad58-951ff49d7d93 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:56.731313 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell0:SELECT=8 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:10:56.738214 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c4928155-30b5-4d71-ad58-951ff49d7d93 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:56.738685 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c4928155-30b5-4d71-ad58-951ff49d7d93 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:56.739532 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c4928155-30b5-4d71-ad58-951ff49d7d93 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:56.739969 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c4928155-30b5-4d71-ad58-951ff49d7d93 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:56.883639 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-c4928155-30b5-4d71-ad58-951ff49d7d93 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:56.891576 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-c4928155-30b5-4d71-ad58-951ff49d7d93 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1575 microversion: 2.1 time: 0.167277 Aug 03 19:10:56.895328 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 277/555] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:56 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:10:57.016335 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-0f6c07bb-5ed9-4077-93cf-7cb6ded153e7 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.139465 Aug 03 19:10:57.016956 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 279/556] 10.222.0.77 () {60 vars in 1147 bytes} [Wed Aug 3 19:10:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 2142 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 19:10:57.028673 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-b9b1b8f4-6dea-464a-bf94-c9aaf6bf7279 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:57.028941 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-b9b1b8f4-6dea-464a-bf94-c9aaf6bf7279 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c33c4d48-ab10-4a55-aca5-b86ad860a568] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:57.092623 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-b9b1b8f4-6dea-464a-bf94-c9aaf6bf7279 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:57.099735 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-b9b1b8f4-6dea-464a-bf94-c9aaf6bf7279 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568" status: 200 len: 1094 microversion: 2.1 time: 0.075608 Aug 03 19:10:57.100301 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 278/557] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:57 2022] GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568 => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:57.107767 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-4ebf6e7a-991a-4cb5-93eb-bf9f19ba871c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:57.108535 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-4ebf6e7a-991a-4cb5-93eb-bf9f19ba871c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:57.118122 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4ebf6e7a-991a-4cb5-93eb-bf9f19ba871c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:57.118720 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4ebf6e7a-991a-4cb5-93eb-bf9f19ba871c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:57.123191 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4ebf6e7a-991a-4cb5-93eb-bf9f19ba871c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:57.123191 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4ebf6e7a-991a-4cb5-93eb-bf9f19ba871c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:57.272775 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-4ebf6e7a-991a-4cb5-93eb-bf9f19ba871c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:57.283150 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-4ebf6e7a-991a-4cb5-93eb-bf9f19ba871c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:57.284829 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-4ebf6e7a-991a-4cb5-93eb-bf9f19ba871c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:57.285934 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-4ebf6e7a-991a-4cb5-93eb-bf9f19ba871c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1406 microversion: 2.20 time: 0.182271 Aug 03 19:10:57.286492 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 280/558] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:10:57 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 19:10:57.914071 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-abd92c0a-9d36-4aba-b1f4-ffe271ba24d5 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:57.914770 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-abd92c0a-9d36-4aba-b1f4-ffe271ba24d5 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:57.921464 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-abd92c0a-9d36-4aba-b1f4-ffe271ba24d5 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:57.922465 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-abd92c0a-9d36-4aba-b1f4-ffe271ba24d5 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:57.923265 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-abd92c0a-9d36-4aba-b1f4-ffe271ba24d5 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:57.923698 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-abd92c0a-9d36-4aba-b1f4-ffe271ba24d5 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:58.063470 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-abd92c0a-9d36-4aba-b1f4-ffe271ba24d5 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:58.071631 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-abd92c0a-9d36-4aba-b1f4-ffe271ba24d5 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1575 microversion: 2.1 time: 0.161925 Aug 03 19:10:58.072215 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 279/559] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:57 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:58.121064 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-ee40dbe9-8f39-44d7-a40d-1a0f6ea9ab18 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:58.121678 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-ee40dbe9-8f39-44d7-a40d-1a0f6ea9ab18 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c33c4d48-ab10-4a55-aca5-b86ad860a568] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:58.129679 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:10:58.183196 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-ee40dbe9-8f39-44d7-a40d-1a0f6ea9ab18 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:58.190671 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-ee40dbe9-8f39-44d7-a40d-1a0f6ea9ab18 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568" status: 200 len: 1094 microversion: 2.1 time: 0.073503 Aug 03 19:10:58.191248 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 281/560] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:58 2022] GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568 => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:58.309193 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-bb9fff08-1dc7-4471-bdaf-8ab227da1f12 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:58.309809 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-bb9fff08-1dc7-4471-bdaf-8ab227da1f12 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:58.316481 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-bb9fff08-1dc7-4471-bdaf-8ab227da1f12 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:58.316868 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-bb9fff08-1dc7-4471-bdaf-8ab227da1f12 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:58.317641 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-bb9fff08-1dc7-4471-bdaf-8ab227da1f12 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:58.318083 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-bb9fff08-1dc7-4471-bdaf-8ab227da1f12 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:58.459283 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-bb9fff08-1dc7-4471-bdaf-8ab227da1f12 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:58.469608 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=100 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:10:58.474621 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-bb9fff08-1dc7-4471-bdaf-8ab227da1f12 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:58.476223 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-bb9fff08-1dc7-4471-bdaf-8ab227da1f12 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:58.477320 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-bb9fff08-1dc7-4471-bdaf-8ab227da1f12 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1406 microversion: 2.20 time: 0.172048 Aug 03 19:10:58.477878 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 280/561] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:10:58 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:10:59.095108 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-6100949c-d971-4054-93ed-db104c52ebdb tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:59.095906 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-6100949c-d971-4054-93ed-db104c52ebdb tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:59.102426 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6100949c-d971-4054-93ed-db104c52ebdb tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:59.102918 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6100949c-d971-4054-93ed-db104c52ebdb tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:59.103704 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6100949c-d971-4054-93ed-db104c52ebdb tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:59.104156 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6100949c-d971-4054-93ed-db104c52ebdb tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:59.213982 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-5365631f-ab99-4ecf-9035-8bb2fd957efe tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:59.214632 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-5365631f-ab99-4ecf-9035-8bb2fd957efe tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c33c4d48-ab10-4a55-aca5-b86ad860a568] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:59.222277 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-5365631f-ab99-4ecf-9035-8bb2fd957efe tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:59.222715 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-5365631f-ab99-4ecf-9035-8bb2fd957efe tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:59.223510 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-5365631f-ab99-4ecf-9035-8bb2fd957efe tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:59.223945 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-5365631f-ab99-4ecf-9035-8bb2fd957efe tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:59.256142 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-6100949c-d971-4054-93ed-db104c52ebdb tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:59.265192 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-6100949c-d971-4054-93ed-db104c52ebdb tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1575 microversion: 2.1 time: 0.175190 Aug 03 19:10:59.274937 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 282/562] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:59 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1575 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:59.295438 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-5365631f-ab99-4ecf-9035-8bb2fd957efe tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:59.304933 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-5365631f-ab99-4ecf-9035-8bb2fd957efe tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568" status: 200 len: 1136 microversion: 2.1 time: 0.094789 Aug 03 19:10:59.305718 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 281/563] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:59 2022] GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568 => generated 1136 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:10:59.501184 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-e1114eba-2065-4659-b7ea-a4f1b0361247 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:59.501801 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-e1114eba-2065-4659-b7ea-a4f1b0361247 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:59.508233 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e1114eba-2065-4659-b7ea-a4f1b0361247 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:59.508682 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e1114eba-2065-4659-b7ea-a4f1b0361247 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:59.509452 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e1114eba-2065-4659-b7ea-a4f1b0361247 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:59.509880 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e1114eba-2065-4659-b7ea-a4f1b0361247 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:59.656448 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-e1114eba-2065-4659-b7ea-a4f1b0361247 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:59.661011 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:10:59.666417 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-e1114eba-2065-4659-b7ea-a4f1b0361247 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:59.668059 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-e1114eba-2065-4659-b7ea-a4f1b0361247 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:59.669244 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-e1114eba-2065-4659-b7ea-a4f1b0361247 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1406 microversion: 2.20 time: 0.172999 Aug 03 19:10:59.669802 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 283/564] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:10:59 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:11:00.287572 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-181fbcc2-dd4c-42d2-87e5-13dfeb274c19 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:11:00.288303 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-181fbcc2-dd4c-42d2-87e5-13dfeb274c19 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:11:00.295735 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-181fbcc2-dd4c-42d2-87e5-13dfeb274c19 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:00.296181 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-181fbcc2-dd4c-42d2-87e5-13dfeb274c19 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:00.297474 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-181fbcc2-dd4c-42d2-87e5-13dfeb274c19 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:00.298271 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-181fbcc2-dd4c-42d2-87e5-13dfeb274c19 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:00.331608 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-3c8c6d5e-96ee-49ae-95c3-1ebb4366e501 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:11:00.332327 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-3c8c6d5e-96ee-49ae-95c3-1ebb4366e501 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c33c4d48-ab10-4a55-aca5-b86ad860a568] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:11:00.340007 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3c8c6d5e-96ee-49ae-95c3-1ebb4366e501 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:00.340482 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3c8c6d5e-96ee-49ae-95c3-1ebb4366e501 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:00.341646 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3c8c6d5e-96ee-49ae-95c3-1ebb4366e501 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:00.341646 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3c8c6d5e-96ee-49ae-95c3-1ebb4366e501 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:00.444725 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-3c8c6d5e-96ee-49ae-95c3-1ebb4366e501 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:00.460402 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-3c8c6d5e-96ee-49ae-95c3-1ebb4366e501 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568" status: 200 len: 1200 microversion: 2.1 time: 0.133179 Aug 03 19:11:00.461283 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 284/565] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:11:00 2022] GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568 => generated 1200 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:11:00.548549 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-181fbcc2-dd4c-42d2-87e5-13dfeb274c19 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:00.563762 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-181fbcc2-dd4c-42d2-87e5-13dfeb274c19 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1575 microversion: 2.1 time: 0.279710 Aug 03 19:11:00.565168 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 282/566] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:11:00 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1575 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:11:00.693992 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-0fc22d9b-b10d-4235-86d3-de0bd36a6e9a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:11:00.694699 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-0fc22d9b-b10d-4235-86d3-de0bd36a6e9a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:11:00.701598 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0fc22d9b-b10d-4235-86d3-de0bd36a6e9a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:00.702033 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0fc22d9b-b10d-4235-86d3-de0bd36a6e9a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:00.703614 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0fc22d9b-b10d-4235-86d3-de0bd36a6e9a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:00.703614 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0fc22d9b-b10d-4235-86d3-de0bd36a6e9a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:00.889845 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-0fc22d9b-b10d-4235-86d3-de0bd36a6e9a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:00.899396 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-0fc22d9b-b10d-4235-86d3-de0bd36a6e9a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:00.900918 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-0fc22d9b-b10d-4235-86d3-de0bd36a6e9a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:00.902073 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-0fc22d9b-b10d-4235-86d3-de0bd36a6e9a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1406 microversion: 2.20 time: 0.212650 Aug 03 19:11:00.903044 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 285/567] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:11:00 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:11:01.495076 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-53234f4d-2082-471c-a647-9528f865eba5 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:11:01.499395 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-53234f4d-2082-471c-a647-9528f865eba5 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c33c4d48-ab10-4a55-aca5-b86ad860a568] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:11:01.510562 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-53234f4d-2082-471c-a647-9528f865eba5 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:01.511766 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-53234f4d-2082-471c-a647-9528f865eba5 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:01.513147 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-53234f4d-2082-471c-a647-9528f865eba5 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:01.514135 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-53234f4d-2082-471c-a647-9528f865eba5 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:01.596488 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-226896b8-86c4-4c2c-99a0-5afc8842c6cb tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:11:01.597553 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-226896b8-86c4-4c2c-99a0-5afc8842c6cb tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:11:01.613642 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-226896b8-86c4-4c2c-99a0-5afc8842c6cb tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:01.628036 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-226896b8-86c4-4c2c-99a0-5afc8842c6cb tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:01.628036 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-226896b8-86c4-4c2c-99a0-5afc8842c6cb tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:01.628036 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-226896b8-86c4-4c2c-99a0-5afc8842c6cb tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:01.771017 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-53234f4d-2082-471c-a647-9528f865eba5 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:01.778818 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-53234f4d-2082-471c-a647-9528f865eba5 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568" status: 200 len: 1277 microversion: 2.1 time: 0.290906 Aug 03 19:11:01.779595 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 283/568] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:11:01 2022] GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568 => generated 1277 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:11:01.834531 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-226896b8-86c4-4c2c-99a0-5afc8842c6cb tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:01.846621 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-226896b8-86c4-4c2c-99a0-5afc8842c6cb tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1575 microversion: 2.1 time: 0.257333 Aug 03 19:11:01.847358 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 286/569] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:11:01 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1575 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:11:01.927783 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-51945d52-fa0b-4af3-be83-5b7ea8b8478a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:11:01.928560 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-51945d52-fa0b-4af3-be83-5b7ea8b8478a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:11:01.931785 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:11:01.935548 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-51945d52-fa0b-4af3-be83-5b7ea8b8478a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:01.936288 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-51945d52-fa0b-4af3-be83-5b7ea8b8478a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:01.937705 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-51945d52-fa0b-4af3-be83-5b7ea8b8478a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:01.938403 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-51945d52-fa0b-4af3-be83-5b7ea8b8478a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:02.225236 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-51945d52-fa0b-4af3-be83-5b7ea8b8478a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:02.235638 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-51945d52-fa0b-4af3-be83-5b7ea8b8478a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:02.237474 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-51945d52-fa0b-4af3-be83-5b7ea8b8478a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:02.238991 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-51945d52-fa0b-4af3-be83-5b7ea8b8478a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1406 microversion: 2.20 time: 0.316288 Aug 03 19:11:02.240139 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 284/570] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:11:01 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1406 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:11:02.802590 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-e2f18cb2-1d76-4924-b0f9-a2e767fe4e8a tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:11:02.803391 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-e2f18cb2-1d76-4924-b0f9-a2e767fe4e8a tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c33c4d48-ab10-4a55-aca5-b86ad860a568] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:11:02.810335 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e2f18cb2-1d76-4924-b0f9-a2e767fe4e8a tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:02.810818 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e2f18cb2-1d76-4924-b0f9-a2e767fe4e8a tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:02.811624 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e2f18cb2-1d76-4924-b0f9-a2e767fe4e8a tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:02.812096 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e2f18cb2-1d76-4924-b0f9-a2e767fe4e8a tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:02.881034 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-3db860bb-758c-43c6-9d55-7ec596d297ea tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:11:02.882065 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-3db860bb-758c-43c6-9d55-7ec596d297ea tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:11:02.891558 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3db860bb-758c-43c6-9d55-7ec596d297ea tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:02.892174 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3db860bb-758c-43c6-9d55-7ec596d297ea tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:02.893317 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3db860bb-758c-43c6-9d55-7ec596d297ea tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:02.893882 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3db860bb-758c-43c6-9d55-7ec596d297ea tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:03.095208 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-e2f18cb2-1d76-4924-b0f9-a2e767fe4e8a tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:03.106399 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-e2f18cb2-1d76-4924-b0f9-a2e767fe4e8a tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568" status: 200 len: 1265 microversion: 2.1 time: 0.307610 Aug 03 19:11:03.107949 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 287/571] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:11:02 2022] GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568 => generated 1265 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:11:03.113822 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [req-7cf29d4c-5787-49f0-9420-327ee67448eb req-7a8dd5a4-af2c-4450-ab6d-5c63a62ab765 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c33c4d48-ab10-4a55-aca5-b86ad860a568", "tag": "00320519-cf37-4866-9293-f5f51d93d44e"}]} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:11:03.124369 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-7cf29d4c-5787-49f0-9420-327ee67448eb req-7a8dd5a4-af2c-4450-ab6d-5c63a62ab765 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:03.126482 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-7cf29d4c-5787-49f0-9420-327ee67448eb req-7a8dd5a4-af2c-4450-ab6d-5c63a62ab765 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:03.155293 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.compute.server_external_events [req-7cf29d4c-5787-49f0-9420-327ee67448eb req-7a8dd5a4-af2c-4450-ab6d-5c63a62ab765 service nova] Creating event network-changed:00320519-cf37-4866-9293-f5f51d93d44e for instance c33c4d48-ab10-4a55-aca5-b86ad860a568 on hv-cinder-85202 Aug 03 19:11:03.163559 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [req-7cf29d4c-5787-49f0-9420-327ee67448eb req-7a8dd5a4-af2c-4450-ab6d-5c63a62ab765 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053859 Aug 03 19:11:03.165377 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 288/572] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:11:03.181503 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-3db860bb-758c-43c6-9d55-7ec596d297ea tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:03.193308 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-3db860bb-758c-43c6-9d55-7ec596d297ea tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1575 microversion: 2.1 time: 0.317030 Aug 03 19:11:03.193917 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 285/573] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:11:02 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1575 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:11:03.272499 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-c25a0b39-adb3-4b70-8070-367ef4679de5 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:11:03.273172 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-c25a0b39-adb3-4b70-8070-367ef4679de5 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:11:03.281375 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c25a0b39-adb3-4b70-8070-367ef4679de5 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:03.281890 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c25a0b39-adb3-4b70-8070-367ef4679de5 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:03.282676 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c25a0b39-adb3-4b70-8070-367ef4679de5 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:03.283323 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c25a0b39-adb3-4b70-8070-367ef4679de5 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:03.484572 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-c25a0b39-adb3-4b70-8070-367ef4679de5 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:03.498769 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-c25a0b39-adb3-4b70-8070-367ef4679de5 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:03.509620 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-c25a0b39-adb3-4b70-8070-367ef4679de5 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:03.511819 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-c25a0b39-adb3-4b70-8070-367ef4679de5 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1406 microversion: 2.20 time: 0.243511 Aug 03 19:11:03.512879 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 289/574] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:11:03 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1406 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:11:03.742434 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-443d834e-07b3-4f8d-8dfd-6b04d7b243b9 req-49c709f0-d278-4e96-a507-d8d75401483f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e21c8ef-c172-41cd-806e-f69f81116b6a", "name": "network-vif-plugged", "status": "completed", "tag": "5bac2969-4e88-4008-93e1-3408ccc91cbb"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:11:03.755949 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-443d834e-07b3-4f8d-8dfd-6b04d7b243b9 req-49c709f0-d278-4e96-a507-d8d75401483f service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:03.757904 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-443d834e-07b3-4f8d-8dfd-6b04d7b243b9 req-49c709f0-d278-4e96-a507-d8d75401483f service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:03.770005 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-443d834e-07b3-4f8d-8dfd-6b04d7b243b9 req-49c709f0-d278-4e96-a507-d8d75401483f service nova] Creating event network-vif-plugged:5bac2969-4e88-4008-93e1-3408ccc91cbb for instance 2e21c8ef-c172-41cd-806e-f69f81116b6a on hv-cinder-85202 Aug 03 19:11:03.774877 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-443d834e-07b3-4f8d-8dfd-6b04d7b243b9 req-49c709f0-d278-4e96-a507-d8d75401483f service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037165 Aug 03 19:11:03.775517 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 286/575] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:11:04.134472 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-05260ea5-ee5d-4333-8748-fd3977610fbd tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:11:04.135339 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-05260ea5-ee5d-4333-8748-fd3977610fbd tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c33c4d48-ab10-4a55-aca5-b86ad860a568] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:11:04.145406 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-05260ea5-ee5d-4333-8748-fd3977610fbd tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:04.145964 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-05260ea5-ee5d-4333-8748-fd3977610fbd tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:04.147366 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-05260ea5-ee5d-4333-8748-fd3977610fbd tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:04.147859 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-05260ea5-ee5d-4333-8748-fd3977610fbd tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:04.216069 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-7ab5bf3f-a96c-4226-9ff0-3879b14255ff tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:11:04.216722 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-7ab5bf3f-a96c-4226-9ff0-3879b14255ff tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:11:04.225567 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7ab5bf3f-a96c-4226-9ff0-3879b14255ff tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:04.226323 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7ab5bf3f-a96c-4226-9ff0-3879b14255ff tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:04.234906 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7ab5bf3f-a96c-4226-9ff0-3879b14255ff tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:04.234906 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7ab5bf3f-a96c-4226-9ff0-3879b14255ff tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:04.337349 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-05260ea5-ee5d-4333-8748-fd3977610fbd tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:04.349432 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-05260ea5-ee5d-4333-8748-fd3977610fbd tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568" status: 200 len: 1265 microversion: 2.1 time: 0.218799 Aug 03 19:11:04.350406 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 290/576] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:11:04 2022] GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568 => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:11:04.426366 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-7ab5bf3f-a96c-4226-9ff0-3879b14255ff tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:04.434362 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-7ab5bf3f-a96c-4226-9ff0-3879b14255ff tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1575 microversion: 2.1 time: 0.222849 Aug 03 19:11:04.435034 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 287/577] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:11:04 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1575 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:11:04.536975 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-2a5d1d4f-14ca-4a41-98bd-45650828b901 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:11:04.537616 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-2a5d1d4f-14ca-4a41-98bd-45650828b901 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:11:04.544369 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2a5d1d4f-14ca-4a41-98bd-45650828b901 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:04.544815 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2a5d1d4f-14ca-4a41-98bd-45650828b901 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:04.545590 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2a5d1d4f-14ca-4a41-98bd-45650828b901 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:04.546032 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2a5d1d4f-14ca-4a41-98bd-45650828b901 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:04.705234 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-2a5d1d4f-14ca-4a41-98bd-45650828b901 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:04.713924 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-2a5d1d4f-14ca-4a41-98bd-45650828b901 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:04.715476 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-2a5d1d4f-14ca-4a41-98bd-45650828b901 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:04.716844 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-2a5d1d4f-14ca-4a41-98bd-45650828b901 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1406 microversion: 2.20 time: 0.183876 Aug 03 19:11:04.717405 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 291/578] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:11:04 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:11:05.380981 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-568407d7-6338-4b3b-b127-847f1eccd090 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:11:05.381729 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-568407d7-6338-4b3b-b127-847f1eccd090 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c33c4d48-ab10-4a55-aca5-b86ad860a568] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:11:05.389226 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-568407d7-6338-4b3b-b127-847f1eccd090 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:05.389711 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-568407d7-6338-4b3b-b127-847f1eccd090 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:05.392070 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-568407d7-6338-4b3b-b127-847f1eccd090 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:05.392070 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-568407d7-6338-4b3b-b127-847f1eccd090 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:05.456882 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-ffc1c173-8d94-4b9f-953d-e6d85c7ae5d2 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:11:05.457705 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-ffc1c173-8d94-4b9f-953d-e6d85c7ae5d2 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:11:05.466336 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ffc1c173-8d94-4b9f-953d-e6d85c7ae5d2 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:05.467483 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ffc1c173-8d94-4b9f-953d-e6d85c7ae5d2 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:05.483800 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ffc1c173-8d94-4b9f-953d-e6d85c7ae5d2 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:05.483800 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ffc1c173-8d94-4b9f-953d-e6d85c7ae5d2 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:05.585725 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-568407d7-6338-4b3b-b127-847f1eccd090 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:05.608603 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-568407d7-6338-4b3b-b127-847f1eccd090 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568" status: 200 len: 1265 microversion: 2.1 time: 0.231356 Aug 03 19:11:05.609953 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 288/579] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:11:05 2022] GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568 => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:11:05.663710 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-ffc1c173-8d94-4b9f-953d-e6d85c7ae5d2 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:05.674109 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-ffc1c173-8d94-4b9f-953d-e6d85c7ae5d2 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1575 microversion: 2.1 time: 0.221140 Aug 03 19:11:05.675219 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 292/580] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:11:05 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1575 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:11:05.749198 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-cb614ce3-26e8-4f33-86a3-f6738a2b1949 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:11:05.750430 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-cb614ce3-26e8-4f33-86a3-f6738a2b1949 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:11:05.756864 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-cb614ce3-26e8-4f33-86a3-f6738a2b1949 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:05.757309 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-cb614ce3-26e8-4f33-86a3-f6738a2b1949 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:05.762486 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-cb614ce3-26e8-4f33-86a3-f6738a2b1949 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:05.762486 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-cb614ce3-26e8-4f33-86a3-f6738a2b1949 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:05.792180 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [req-e4350641-e9b9-4445-bcdb-6e75bf6b0e14 req-8250c788-19f1-4d6e-9ff1-770058e86ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c5a48c7-6f8c-4016-9bdc-257578d6c207", "name": "network-vif-plugged", "status": "completed", "tag": "a29c7b71-aaab-4c8a-afd0-f196f7f95847"}]} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:11:05.802629 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-e4350641-e9b9-4445-bcdb-6e75bf6b0e14 req-8250c788-19f1-4d6e-9ff1-770058e86ec5 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:05.803104 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-e4350641-e9b9-4445-bcdb-6e75bf6b0e14 req-8250c788-19f1-4d6e-9ff1-770058e86ec5 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:05.817489 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.compute.server_external_events [req-e4350641-e9b9-4445-bcdb-6e75bf6b0e14 req-8250c788-19f1-4d6e-9ff1-770058e86ec5 service nova] Creating event network-vif-plugged:a29c7b71-aaab-4c8a-afd0-f196f7f95847 for instance 2c5a48c7-6f8c-4016-9bdc-257578d6c207 on hv-cinder-85202 Aug 03 19:11:05.822600 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [req-e4350641-e9b9-4445-bcdb-6e75bf6b0e14 req-8250c788-19f1-4d6e-9ff1-770058e86ec5 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034334 Aug 03 19:11:05.823515 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 293/581] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 19:11:05.913132 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-cb614ce3-26e8-4f33-86a3-f6738a2b1949 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:05.921389 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-cb614ce3-26e8-4f33-86a3-f6738a2b1949 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:05.923838 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-cb614ce3-26e8-4f33-86a3-f6738a2b1949 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:05.924951 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-cb614ce3-26e8-4f33-86a3-f6738a2b1949 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1406 microversion: 2.20 time: 0.179730 Aug 03 19:11:05.925502 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 289/582] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:11:05 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 19:11:06.630784 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-313d2d50-31db-47f9-b785-c8e278106f70 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:11:06.632203 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-313d2d50-31db-47f9-b785-c8e278106f70 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c33c4d48-ab10-4a55-aca5-b86ad860a568] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:11:06.639095 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell0:SELECT=2 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:11:06.642767 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-313d2d50-31db-47f9-b785-c8e278106f70 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:06.643250 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-313d2d50-31db-47f9-b785-c8e278106f70 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:06.644207 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-313d2d50-31db-47f9-b785-c8e278106f70 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:06.644654 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-313d2d50-31db-47f9-b785-c8e278106f70 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:06.698603 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-718f7a42-8096-4ff7-83de-eeb11fa7b7a9 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:11:06.699579 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-718f7a42-8096-4ff7-83de-eeb11fa7b7a9 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:11:06.709728 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-718f7a42-8096-4ff7-83de-eeb11fa7b7a9 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:06.710425 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-718f7a42-8096-4ff7-83de-eeb11fa7b7a9 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:06.710986 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-718f7a42-8096-4ff7-83de-eeb11fa7b7a9 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:06.711424 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-718f7a42-8096-4ff7-83de-eeb11fa7b7a9 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:06.927613 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-313d2d50-31db-47f9-b785-c8e278106f70 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:06.937457 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-313d2d50-31db-47f9-b785-c8e278106f70 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568" status: 200 len: 1265 microversion: 2.1 time: 0.310938 Aug 03 19:11:06.938063 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 294/583] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:11:06 2022] GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568 => generated 1265 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:11:06.943347 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-718f7a42-8096-4ff7-83de-eeb11fa7b7a9 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:06.951657 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-cc5618d8-0840-49f6-8be9-4396ec89f659 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:11:06.961828 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-718f7a42-8096-4ff7-83de-eeb11fa7b7a9 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1575 microversion: 2.1 time: 0.256984 Aug 03 19:11:06.961828 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 290/584] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:11:06 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1575 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:11:06.962066 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-cc5618d8-0840-49f6-8be9-4396ec89f659 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:11:06.962066 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cc5618d8-0840-49f6-8be9-4396ec89f659 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:06.962066 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cc5618d8-0840-49f6-8be9-4396ec89f659 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:06.962066 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cc5618d8-0840-49f6-8be9-4396ec89f659 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:06.962428 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cc5618d8-0840-49f6-8be9-4396ec89f659 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:07.113417 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-cc5618d8-0840-49f6-8be9-4396ec89f659 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:07.121668 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-cc5618d8-0840-49f6-8be9-4396ec89f659 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:07.123224 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-cc5618d8-0840-49f6-8be9-4396ec89f659 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:07.125407 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-cc5618d8-0840-49f6-8be9-4396ec89f659 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1406 microversion: 2.20 time: 0.177607 Aug 03 19:11:07.126152 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 295/585] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:11:06 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:11:07.968629 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-f6c11961-2a8a-4175-9024-1d12589eabda tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:11:07.969553 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-f6c11961-2a8a-4175-9024-1d12589eabda tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c33c4d48-ab10-4a55-aca5-b86ad860a568] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:11:07.971653 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell0:SELECT=2 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:11:07.977187 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f6c11961-2a8a-4175-9024-1d12589eabda tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:07.977632 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f6c11961-2a8a-4175-9024-1d12589eabda tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:07.978398 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f6c11961-2a8a-4175-9024-1d12589eabda tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:07.978827 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f6c11961-2a8a-4175-9024-1d12589eabda tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:07.979902 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-946aa798-2569-44a0-b66d-96885ca46704 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:11:07.980491 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-946aa798-2569-44a0-b66d-96885ca46704 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:11:07.987308 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-946aa798-2569-44a0-b66d-96885ca46704 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:07.987759 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-946aa798-2569-44a0-b66d-96885ca46704 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:07.988638 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-946aa798-2569-44a0-b66d-96885ca46704 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:07.989065 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-946aa798-2569-44a0-b66d-96885ca46704 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:08.187713 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell0:SELECT=8 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:11:08.188925 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-f6c11961-2a8a-4175-9024-1d12589eabda tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:08.193829 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-946aa798-2569-44a0-b66d-96885ca46704 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:08.197003 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-f6c11961-2a8a-4175-9024-1d12589eabda tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568" status: 200 len: 1265 microversion: 2.1 time: 0.235714 Aug 03 19:11:08.197600 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 291/586] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:11:07 2022] GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568 => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:11:08.202477 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-aef2675f-0e1d-4dc3-82a7-4d1f08cb5f73 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:11:08.203856 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-aef2675f-0e1d-4dc3-82a7-4d1f08cb5f73 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:11:08.206421 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-946aa798-2569-44a0-b66d-96885ca46704 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1575 microversion: 2.1 time: 0.230533 Aug 03 19:11:08.207280 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 296/587] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:11:07 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1575 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:11:08.211478 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-aef2675f-0e1d-4dc3-82a7-4d1f08cb5f73 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:08.216479 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-aef2675f-0e1d-4dc3-82a7-4d1f08cb5f73 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:08.216479 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-aef2675f-0e1d-4dc3-82a7-4d1f08cb5f73 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:08.216479 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-aef2675f-0e1d-4dc3-82a7-4d1f08cb5f73 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:08.371194 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-aef2675f-0e1d-4dc3-82a7-4d1f08cb5f73 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:08.381479 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-aef2675f-0e1d-4dc3-82a7-4d1f08cb5f73 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:08.383122 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-aef2675f-0e1d-4dc3-82a7-4d1f08cb5f73 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:08.384290 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-aef2675f-0e1d-4dc3-82a7-4d1f08cb5f73 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1598 microversion: 2.20 time: 0.185806 Aug 03 19:11:08.384944 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 292/588] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:11:08 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1598 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:11:08.409968 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-fb05dec4-74b6-4c24-915b-48bad697f456 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:11:08.411385 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-fb05dec4-74b6-4c24-915b-48bad697f456 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:11:08.419745 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fb05dec4-74b6-4c24-915b-48bad697f456 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:08.420440 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fb05dec4-74b6-4c24-915b-48bad697f456 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:08.422296 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fb05dec4-74b6-4c24-915b-48bad697f456 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:08.423023 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fb05dec4-74b6-4c24-915b-48bad697f456 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:08.518386 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-fb05dec4-74b6-4c24-915b-48bad697f456 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.114307 Aug 03 19:11:08.519018 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 297/589] 10.222.0.77 () {60 vars in 1316 bytes} [Wed Aug 3 19:11:08 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 19:11:09.217700 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-3a168f08-a512-4692-a1bd-2e92eccd6b8a tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:11:09.218535 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-3a168f08-a512-4692-a1bd-2e92eccd6b8a tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c33c4d48-ab10-4a55-aca5-b86ad860a568] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:11:09.225588 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3a168f08-a512-4692-a1bd-2e92eccd6b8a tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:09.226041 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3a168f08-a512-4692-a1bd-2e92eccd6b8a tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:09.226826 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3a168f08-a512-4692-a1bd-2e92eccd6b8a tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:09.227312 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3a168f08-a512-4692-a1bd-2e92eccd6b8a tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:09.230041 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-a95c12a3-c8b0-40f4-9107-d8a6ea39f3a1 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:11:09.230875 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-a95c12a3-c8b0-40f4-9107-d8a6ea39f3a1 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:11:09.238160 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a95c12a3-c8b0-40f4-9107-d8a6ea39f3a1 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:09.251064 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a95c12a3-c8b0-40f4-9107-d8a6ea39f3a1 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:09.252092 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a95c12a3-c8b0-40f4-9107-d8a6ea39f3a1 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:09.252734 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a95c12a3-c8b0-40f4-9107-d8a6ea39f3a1 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:09.464042 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-3a168f08-a512-4692-a1bd-2e92eccd6b8a tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:09.473362 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-3a168f08-a512-4692-a1bd-2e92eccd6b8a tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568" status: 200 len: 1265 microversion: 2.1 time: 0.259367 Aug 03 19:11:09.474308 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 293/590] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:11:09 2022] GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568 => generated 1265 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:11:09.489138 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-a95c12a3-c8b0-40f4-9107-d8a6ea39f3a1 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:09.499173 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-a95c12a3-c8b0-40f4-9107-d8a6ea39f3a1 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1562 microversion: 2.1 time: 0.273871 Aug 03 19:11:09.500386 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 298/591] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:11:09 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1562 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:11:09.961045 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-084970c0-8799-46d2-81b3-5e1b79eb3d53 req-ee53fc58-e8a6-449d-9154-a5d7e90217a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e21c8ef-c172-41cd-806e-f69f81116b6a", "tag": "5bac2969-4e88-4008-93e1-3408ccc91cbb"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:11:09.978565 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-084970c0-8799-46d2-81b3-5e1b79eb3d53 req-ee53fc58-e8a6-449d-9154-a5d7e90217a0 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:09.979128 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-084970c0-8799-46d2-81b3-5e1b79eb3d53 req-ee53fc58-e8a6-449d-9154-a5d7e90217a0 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:09.993331 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-084970c0-8799-46d2-81b3-5e1b79eb3d53 req-ee53fc58-e8a6-449d-9154-a5d7e90217a0 service nova] Creating event network-changed:5bac2969-4e88-4008-93e1-3408ccc91cbb for instance 2e21c8ef-c172-41cd-806e-f69f81116b6a on hv-cinder-85202 Aug 03 19:11:09.999987 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-084970c0-8799-46d2-81b3-5e1b79eb3d53 req-ee53fc58-e8a6-449d-9154-a5d7e90217a0 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042005 Aug 03 19:11:10.001115 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 294/592] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:11:10.496298 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-ddba7fe1-473d-43f7-88b3-a9e143bccd2b tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:11:10.497015 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-ddba7fe1-473d-43f7-88b3-a9e143bccd2b tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c33c4d48-ab10-4a55-aca5-b86ad860a568] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:11:10.510025 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ddba7fe1-473d-43f7-88b3-a9e143bccd2b tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:10.511145 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ddba7fe1-473d-43f7-88b3-a9e143bccd2b tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:10.512012 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ddba7fe1-473d-43f7-88b3-a9e143bccd2b tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:10.512823 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ddba7fe1-473d-43f7-88b3-a9e143bccd2b tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:10.680606 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-ddba7fe1-473d-43f7-88b3-a9e143bccd2b tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:10.689189 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-ddba7fe1-473d-43f7-88b3-a9e143bccd2b tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568" status: 200 len: 1265 microversion: 2.1 time: 0.196647 Aug 03 19:11:10.689775 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 299/593] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:11:10 2022] GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568 => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:11:11.720936 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-3a14048f-8a25-48ac-a5f3-d6e1db394228 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:11:11.721679 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-3a14048f-8a25-48ac-a5f3-d6e1db394228 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c33c4d48-ab10-4a55-aca5-b86ad860a568] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:11:11.727983 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3a14048f-8a25-48ac-a5f3-d6e1db394228 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:11.728457 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3a14048f-8a25-48ac-a5f3-d6e1db394228 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:11.729222 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3a14048f-8a25-48ac-a5f3-d6e1db394228 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:11.729657 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3a14048f-8a25-48ac-a5f3-d6e1db394228 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:11.888074 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-3a14048f-8a25-48ac-a5f3-d6e1db394228 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:11.897120 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-3a14048f-8a25-48ac-a5f3-d6e1db394228 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568" status: 200 len: 1265 microversion: 2.1 time: 0.181210 Aug 03 19:11:11.897687 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 295/594] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:11:11 2022] GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:11:12.920286 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-59798e3c-4c39-47ae-b704-8d74252f5694 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:11:12.920905 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-59798e3c-4c39-47ae-b704-8d74252f5694 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c33c4d48-ab10-4a55-aca5-b86ad860a568] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:11:12.928511 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-59798e3c-4c39-47ae-b704-8d74252f5694 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:12.928959 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-59798e3c-4c39-47ae-b704-8d74252f5694 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:12.929732 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-59798e3c-4c39-47ae-b704-8d74252f5694 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:12.930172 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-59798e3c-4c39-47ae-b704-8d74252f5694 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:13.070657 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-59798e3c-4c39-47ae-b704-8d74252f5694 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:13.078822 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-59798e3c-4c39-47ae-b704-8d74252f5694 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568" status: 200 len: 1265 microversion: 2.1 time: 0.162451 Aug 03 19:11:13.086407 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 300/595] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:11:12 2022] GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:11:14.100118 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-7b009d30-6907-4671-b553-d01e22398300 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:11:14.100836 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-7b009d30-6907-4671-b553-d01e22398300 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c33c4d48-ab10-4a55-aca5-b86ad860a568] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:11:14.107701 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7b009d30-6907-4671-b553-d01e22398300 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:14.108159 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7b009d30-6907-4671-b553-d01e22398300 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:14.109472 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7b009d30-6907-4671-b553-d01e22398300 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:14.109951 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7b009d30-6907-4671-b553-d01e22398300 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:14.259459 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-7b009d30-6907-4671-b553-d01e22398300 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:14.267595 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-7b009d30-6907-4671-b553-d01e22398300 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568" status: 200 len: 1265 microversion: 2.1 time: 0.171384 Aug 03 19:11:14.268177 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 296/596] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:11:14 2022] GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:11:15.288189 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-aefd6690-5e2f-4f52-98f6-d9cd62cd46bb tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:11:15.288802 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-aefd6690-5e2f-4f52-98f6-d9cd62cd46bb tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c33c4d48-ab10-4a55-aca5-b86ad860a568] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:11:15.295766 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-aefd6690-5e2f-4f52-98f6-d9cd62cd46bb tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:15.296216 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-aefd6690-5e2f-4f52-98f6-d9cd62cd46bb tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:15.297239 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-aefd6690-5e2f-4f52-98f6-d9cd62cd46bb tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:15.297685 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-aefd6690-5e2f-4f52-98f6-d9cd62cd46bb tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:15.438174 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-aefd6690-5e2f-4f52-98f6-d9cd62cd46bb tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:15.446074 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-aefd6690-5e2f-4f52-98f6-d9cd62cd46bb tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568" status: 200 len: 1265 microversion: 2.1 time: 0.161850 Aug 03 19:11:15.446644 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 301/597] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:11:15 2022] GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:11:15.582203 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-b64f4421-fa01-40af-9a43-da0a8092688f req-28d4b8a5-59de-4f1a-9e06-f78783cc9b2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c33c4d48-ab10-4a55-aca5-b86ad860a568", "name": "network-vif-plugged", "status": "completed", "tag": "00320519-cf37-4866-9293-f5f51d93d44e"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:11:15.591679 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-b64f4421-fa01-40af-9a43-da0a8092688f req-28d4b8a5-59de-4f1a-9e06-f78783cc9b2a service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:15.592126 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-b64f4421-fa01-40af-9a43-da0a8092688f req-28d4b8a5-59de-4f1a-9e06-f78783cc9b2a service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:15.605531 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-b64f4421-fa01-40af-9a43-da0a8092688f req-28d4b8a5-59de-4f1a-9e06-f78783cc9b2a service nova] Creating event network-vif-plugged:00320519-cf37-4866-9293-f5f51d93d44e for instance c33c4d48-ab10-4a55-aca5-b86ad860a568 on hv-cinder-85202 Aug 03 19:11:15.613173 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-b64f4421-fa01-40af-9a43-da0a8092688f req-28d4b8a5-59de-4f1a-9e06-f78783cc9b2a service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036314 Aug 03 19:11:15.613173 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 297/598] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:11:16.468652 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-143267c1-5221-4a3b-8033-915c49fc6de7 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:11:16.469277 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-143267c1-5221-4a3b-8033-915c49fc6de7 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c33c4d48-ab10-4a55-aca5-b86ad860a568] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:11:16.476050 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-143267c1-5221-4a3b-8033-915c49fc6de7 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:16.476493 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-143267c1-5221-4a3b-8033-915c49fc6de7 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:16.477264 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-143267c1-5221-4a3b-8033-915c49fc6de7 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:16.477697 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-143267c1-5221-4a3b-8033-915c49fc6de7 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:16.481855 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=100 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:11:16.625896 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-143267c1-5221-4a3b-8033-915c49fc6de7 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:16.633400 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-143267c1-5221-4a3b-8033-915c49fc6de7 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568" status: 200 len: 1265 microversion: 2.1 time: 0.168883 Aug 03 19:11:16.633990 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 302/599] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:11:16 2022] GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:11:17.656462 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-08c928d9-708a-43eb-af48-d20bb481fad1 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:11:17.657172 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-08c928d9-708a-43eb-af48-d20bb481fad1 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c33c4d48-ab10-4a55-aca5-b86ad860a568] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:11:17.664032 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-08c928d9-708a-43eb-af48-d20bb481fad1 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:17.670876 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-08c928d9-708a-43eb-af48-d20bb481fad1 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:17.670876 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-08c928d9-708a-43eb-af48-d20bb481fad1 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:17.670876 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-08c928d9-708a-43eb-af48-d20bb481fad1 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:17.811273 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-08c928d9-708a-43eb-af48-d20bb481fad1 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:17.820300 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-08c928d9-708a-43eb-af48-d20bb481fad1 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568" status: 200 len: 1265 microversion: 2.1 time: 0.169148 Aug 03 19:11:17.820876 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 298/600] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:11:17 2022] GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:11:18.841925 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-284bad7c-f5a4-4dcb-a44f-ee18c9d76bc1 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:11:18.842687 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-284bad7c-f5a4-4dcb-a44f-ee18c9d76bc1 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c33c4d48-ab10-4a55-aca5-b86ad860a568] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:11:18.849602 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-284bad7c-f5a4-4dcb-a44f-ee18c9d76bc1 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:18.850045 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-284bad7c-f5a4-4dcb-a44f-ee18c9d76bc1 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:18.850845 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-284bad7c-f5a4-4dcb-a44f-ee18c9d76bc1 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:18.851318 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-284bad7c-f5a4-4dcb-a44f-ee18c9d76bc1 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:18.996357 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-284bad7c-f5a4-4dcb-a44f-ee18c9d76bc1 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:19.004323 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-284bad7c-f5a4-4dcb-a44f-ee18c9d76bc1 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568" status: 200 len: 1452 microversion: 2.1 time: 0.166473 Aug 03 19:11:19.004886 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 303/601] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:11:18 2022] GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568 => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:11:19.024632 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-f0880446-a739-4017-8e3a-d430ebf0991d tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:11:19.025245 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-f0880446-a739-4017-8e3a-d430ebf0991d tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c33c4d48-ab10-4a55-aca5-b86ad860a568] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:11:19.032567 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f0880446-a739-4017-8e3a-d430ebf0991d tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:19.033064 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f0880446-a739-4017-8e3a-d430ebf0991d tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:19.033933 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f0880446-a739-4017-8e3a-d430ebf0991d tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:19.034234 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f0880446-a739-4017-8e3a-d430ebf0991d tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:19.055499 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=100 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:11:19.181492 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-f0880446-a739-4017-8e3a-d430ebf0991d tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:11:19.189779 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-f0880446-a739-4017-8e3a-d430ebf0991d tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568" status: 200 len: 1452 microversion: 2.1 time: 0.168974 Aug 03 19:11:19.190347 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 299/602] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:11:19 2022] GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568 => generated 1452 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:11:21.370517 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [req-523902a6-e51c-43f0-b9f7-bae0ee712663 req-c8800b3c-d58f-476d-b28c-68ca1dd24ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c33c4d48-ab10-4a55-aca5-b86ad860a568", "tag": "00320519-cf37-4866-9293-f5f51d93d44e"}]} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:11:21.386429 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-523902a6-e51c-43f0-b9f7-bae0ee712663 req-c8800b3c-d58f-476d-b28c-68ca1dd24ee2 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:11:21.387216 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-523902a6-e51c-43f0-b9f7-bae0ee712663 req-c8800b3c-d58f-476d-b28c-68ca1dd24ee2 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:11:21.405396 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.compute.server_external_events [req-523902a6-e51c-43f0-b9f7-bae0ee712663 req-c8800b3c-d58f-476d-b28c-68ca1dd24ee2 service nova] Creating event network-changed:00320519-cf37-4866-9293-f5f51d93d44e for instance c33c4d48-ab10-4a55-aca5-b86ad860a568 on hv-cinder-85202 Aug 03 19:11:21.411640 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [req-523902a6-e51c-43f0-b9f7-bae0ee712663 req-c8800b3c-d58f-476d-b28c-68ca1dd24ee2 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047228 Aug 03 19:11:21.412609 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 304/603] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:12:09.767751 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-4879ee8d-2edb-46ad-9368-3f82cc4f5722 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:09.768395 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-4879ee8d-2edb-46ad-9368-3f82cc4f5722 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: 48911604-e8be-4ada-b8aa-e9468ea89514] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:09.770352 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_api:SELECT=30 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:12:09.771047 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=2 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:12:09.775872 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4879ee8d-2edb-46ad-9368-3f82cc4f5722 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:09.776316 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4879ee8d-2edb-46ad-9368-3f82cc4f5722 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:09.777083 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4879ee8d-2edb-46ad-9368-3f82cc4f5722 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:09.777513 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4879ee8d-2edb-46ad-9368-3f82cc4f5722 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:09.805282 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-4879ee8d-2edb-46ad-9368-3f82cc4f5722 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514/ips" status: 200 len: 145 microversion: 2.1 time: 0.042241 Aug 03 19:12:09.805870 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 300/604] 10.222.0.77 () {58 vars in 1248 bytes} [Wed Aug 3 19:12:09 2022] GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514/ips => generated 145 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 19:12:12.747983 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-1de11958-4881-4b64-919a-fc4209dda889 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ddb6f833-fef5-44c6-a140-88a0d14a1a3a"}} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:12:12.751178 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-1de11958-4881-4b64-919a-fc4209dda889 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: 48911604-e8be-4ada-b8aa-e9468ea89514] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:12.753564 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_api:SELECT=47 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:12:12.754216 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=12 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:12:12.759744 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1de11958-4881-4b64-919a-fc4209dda889 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:12.760210 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1de11958-4881-4b64-919a-fc4209dda889 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:12.761074 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1de11958-4881-4b64-919a-fc4209dda889 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:12.761541 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1de11958-4881-4b64-919a-fc4209dda889 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:13.812892 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-1de11958-4881-4b64-919a-fc4209dda889 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "POST /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.068535 Aug 03 19:12:13.813553 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 305/605] 10.222.0.77 () {60 vars in 1323 bytes} [Wed Aug 3 19:12:12 2022] POST /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514/os-volume_attachments => generated 194 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:12:22.441305 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-44d3b2fd-c7f5-40ad-9705-1cf8fb6c4319 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:22.443516 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-44d3b2fd-c7f5-40ad-9705-1cf8fb6c4319 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: 48911604-e8be-4ada-b8aa-e9468ea89514] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:22.449670 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-44d3b2fd-c7f5-40ad-9705-1cf8fb6c4319 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:22.450098 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-44d3b2fd-c7f5-40ad-9705-1cf8fb6c4319 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:22.450860 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-44d3b2fd-c7f5-40ad-9705-1cf8fb6c4319 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:22.451327 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-44d3b2fd-c7f5-40ad-9705-1cf8fb6c4319 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:22.481852 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-44d3b2fd-c7f5-40ad-9705-1cf8fb6c4319 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045388 Aug 03 19:12:22.482415 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 301/606] 10.222.0.77 () {58 vars in 1302 bytes} [Wed Aug 3 19:12:22 2022] GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:12:22.494362 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-3097da9b-0ed3-4fae-90bb-43bfc6f1cd0c tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:22.494959 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-3097da9b-0ed3-4fae-90bb-43bfc6f1cd0c tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: 48911604-e8be-4ada-b8aa-e9468ea89514] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:22.502389 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3097da9b-0ed3-4fae-90bb-43bfc6f1cd0c tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:22.502748 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3097da9b-0ed3-4fae-90bb-43bfc6f1cd0c tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:22.503533 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3097da9b-0ed3-4fae-90bb-43bfc6f1cd0c tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:22.503969 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3097da9b-0ed3-4fae-90bb-43bfc6f1cd0c tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:22.533394 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-3097da9b-0ed3-4fae-90bb-43bfc6f1cd0c tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514/os-volume_attachments/ddb6f833-fef5-44c6-a140-88a0d14a1a3a" status: 200 len: 194 microversion: 2.1 time: 0.043241 Aug 03 19:12:22.534061 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 306/607] 10.222.0.77 () {58 vars in 1413 bytes} [Wed Aug 3 19:12:22 2022] GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514/os-volume_attachments/ddb6f833-fef5-44c6-a140-88a0d14a1a3a => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:12:24.065498 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-5a21fa8a-14a2-4669-a401-33dffde87e03 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd7792a0-9ae2-4231-9d1e-537724b9b989"}} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:12:24.067835 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-5a21fa8a-14a2-4669-a401-33dffde87e03 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: 48911604-e8be-4ada-b8aa-e9468ea89514] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:24.074286 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-5a21fa8a-14a2-4669-a401-33dffde87e03 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:24.074730 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-5a21fa8a-14a2-4669-a401-33dffde87e03 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:24.076745 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-5a21fa8a-14a2-4669-a401-33dffde87e03 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:24.076745 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-5a21fa8a-14a2-4669-a401-33dffde87e03 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:24.828931 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-5a21fa8a-14a2-4669-a401-33dffde87e03 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "POST /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.766838 Aug 03 19:12:24.829984 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 302/608] 10.222.0.77 () {60 vars in 1323 bytes} [Wed Aug 3 19:12:24 2022] POST /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514/os-volume_attachments => generated 194 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 19:12:33.433978 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-4602745e-1b75-4d73-9949-f711ce6c8446 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:33.436263 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-4602745e-1b75-4d73-9949-f711ce6c8446 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: 48911604-e8be-4ada-b8aa-e9468ea89514] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:33.438804 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_api:SELECT=4 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:12:33.439502 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:12:33.444245 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4602745e-1b75-4d73-9949-f711ce6c8446 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:33.444696 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4602745e-1b75-4d73-9949-f711ce6c8446 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:33.445486 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4602745e-1b75-4d73-9949-f711ce6c8446 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:33.445930 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4602745e-1b75-4d73-9949-f711ce6c8446 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:33.477141 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-4602745e-1b75-4d73-9949-f711ce6c8446 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047276 Aug 03 19:12:33.477694 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 307/609] 10.222.0.77 () {58 vars in 1302 bytes} [Wed Aug 3 19:12:33 2022] GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:12:33.629364 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-5d53cdca-4650-4b09-97ce-ffd8aa719ec9 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:33.630004 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-5d53cdca-4650-4b09-97ce-ffd8aa719ec9 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: 48911604-e8be-4ada-b8aa-e9468ea89514] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:33.638248 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-5d53cdca-4650-4b09-97ce-ffd8aa719ec9 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:33.638685 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-5d53cdca-4650-4b09-97ce-ffd8aa719ec9 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:33.639519 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-5d53cdca-4650-4b09-97ce-ffd8aa719ec9 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:33.639953 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-5d53cdca-4650-4b09-97ce-ffd8aa719ec9 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:33.670932 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-5d53cdca-4650-4b09-97ce-ffd8aa719ec9 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514/os-volume_attachments/ddb6f833-fef5-44c6-a140-88a0d14a1a3a" status: 200 len: 194 microversion: 2.1 time: 0.046612 Aug 03 19:12:33.671533 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 303/610] 10.222.0.77 () {58 vars in 1413 bytes} [Wed Aug 3 19:12:33 2022] GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514/os-volume_attachments/ddb6f833-fef5-44c6-a140-88a0d14a1a3a => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:12:33.682264 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-9fad8192-1291-4992-a04e-cb6fdc14d4b3 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:33.682756 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-9fad8192-1291-4992-a04e-cb6fdc14d4b3 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: 48911604-e8be-4ada-b8aa-e9468ea89514] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:33.690424 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9fad8192-1291-4992-a04e-cb6fdc14d4b3 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:33.690864 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9fad8192-1291-4992-a04e-cb6fdc14d4b3 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:33.691654 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9fad8192-1291-4992-a04e-cb6fdc14d4b3 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:33.692087 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9fad8192-1291-4992-a04e-cb6fdc14d4b3 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:33.777248 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.objects.instance [None req-9fad8192-1291-4992-a04e-cb6fdc14d4b3 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lazy-loading 'services' on Instance uuid 48911604-e8be-4ada-b8aa-e9468ea89514 {{(pid=118303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:12:34.003518 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-9fad8192-1291-4992-a04e-cb6fdc14d4b3 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "DELETE /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514/os-volume_attachments/ddb6f833-fef5-44c6-a140-88a0d14a1a3a" status: 202 len: 0 microversion: 2.1 time: 0.325021 Aug 03 19:12:34.004121 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 308/611] 10.222.0.77 () {58 vars in 1416 bytes} [Wed Aug 3 19:12:33 2022] DELETE /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514/os-volume_attachments/ddb6f833-fef5-44c6-a140-88a0d14a1a3a => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 19:12:36.187692 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-a3f68ba9-7b18-4c1d-9c70-1513a6507f16 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:36.188284 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-a3f68ba9-7b18-4c1d-9c70-1513a6507f16 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: 48911604-e8be-4ada-b8aa-e9468ea89514] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:36.199375 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a3f68ba9-7b18-4c1d-9c70-1513a6507f16 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:36.199858 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a3f68ba9-7b18-4c1d-9c70-1513a6507f16 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:36.200640 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a3f68ba9-7b18-4c1d-9c70-1513a6507f16 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:36.201083 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a3f68ba9-7b18-4c1d-9c70-1513a6507f16 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:36.233141 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-a3f68ba9-7b18-4c1d-9c70-1513a6507f16 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514/os-volume_attachments/dd7792a0-9ae2-4231-9d1e-537724b9b989" status: 200 len: 194 microversion: 2.1 time: 0.049283 Aug 03 19:12:36.233767 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 304/612] 10.222.0.77 () {58 vars in 1413 bytes} [Wed Aug 3 19:12:36 2022] GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514/os-volume_attachments/dd7792a0-9ae2-4231-9d1e-537724b9b989 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 19:12:36.245676 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-b2d619c1-94b2-4d1d-ba0d-53417a72daaa tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:36.246275 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-b2d619c1-94b2-4d1d-ba0d-53417a72daaa tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: 48911604-e8be-4ada-b8aa-e9468ea89514] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:36.253082 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b2d619c1-94b2-4d1d-ba0d-53417a72daaa tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:36.253531 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b2d619c1-94b2-4d1d-ba0d-53417a72daaa tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:36.254307 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b2d619c1-94b2-4d1d-ba0d-53417a72daaa tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:36.254746 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b2d619c1-94b2-4d1d-ba0d-53417a72daaa tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:36.339774 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.objects.instance [None req-b2d619c1-94b2-4d1d-ba0d-53417a72daaa tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lazy-loading 'services' on Instance uuid 48911604-e8be-4ada-b8aa-e9468ea89514 {{(pid=118303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:12:36.619515 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-b2d619c1-94b2-4d1d-ba0d-53417a72daaa tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "DELETE /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514/os-volume_attachments/dd7792a0-9ae2-4231-9d1e-537724b9b989" status: 202 len: 0 microversion: 2.1 time: 0.378388 Aug 03 19:12:36.620141 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 309/613] 10.222.0.77 () {58 vars in 1416 bytes} [Wed Aug 3 19:12:36 2022] DELETE /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514/os-volume_attachments/dd7792a0-9ae2-4231-9d1e-537724b9b989 => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 19:12:37.634424 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-fe927c31-2185-4745-b349-20380067b3e9 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:37.634985 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-fe927c31-2185-4745-b349-20380067b3e9 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:37.641854 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fe927c31-2185-4745-b349-20380067b3e9 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:37.642308 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fe927c31-2185-4745-b349-20380067b3e9 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:37.643109 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fe927c31-2185-4745-b349-20380067b3e9 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:37.643543 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fe927c31-2185-4745-b349-20380067b3e9 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:37.668527 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-fe927c31-2185-4745-b349-20380067b3e9 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a/ips" status: 200 len: 150 microversion: 2.20 time: 0.038061 Aug 03 19:12:37.669372 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 305/614] 10.222.0.77 () {60 vars in 1289 bytes} [Wed Aug 3 19:12:37 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 19:12:37.902936 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-e24cd256-2dda-4a41-9401-92add6a55cf5 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:37.905230 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-e24cd256-2dda-4a41-9401-92add6a55cf5 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: 48911604-e8be-4ada-b8aa-e9468ea89514] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:37.920257 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e24cd256-2dda-4a41-9401-92add6a55cf5 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:37.921065 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e24cd256-2dda-4a41-9401-92add6a55cf5 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:37.921488 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e24cd256-2dda-4a41-9401-92add6a55cf5 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:37.921921 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e24cd256-2dda-4a41-9401-92add6a55cf5 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:37.954539 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-e24cd256-2dda-4a41-9401-92add6a55cf5 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056875 Aug 03 19:12:37.955055 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 310/615] 10.222.0.77 () {58 vars in 1302 bytes} [Wed Aug 3 19:12:37 2022] GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 19:12:38.084503 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-741d0a34-ccf6-4aff-bb14-483a213b1afe tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:38.086745 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-741d0a34-ccf6-4aff-bb14-483a213b1afe tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: 48911604-e8be-4ada-b8aa-e9468ea89514] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:38.093136 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-741d0a34-ccf6-4aff-bb14-483a213b1afe tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:38.093758 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-741d0a34-ccf6-4aff-bb14-483a213b1afe tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:38.095190 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-741d0a34-ccf6-4aff-bb14-483a213b1afe tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:38.095873 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-741d0a34-ccf6-4aff-bb14-483a213b1afe tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:38.135964 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-741d0a34-ccf6-4aff-bb14-483a213b1afe tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055895 Aug 03 19:12:38.136557 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 306/616] 10.222.0.77 () {58 vars in 1302 bytes} [Wed Aug 3 19:12:38 2022] GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 03 19:12:38.212542 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-8bba2825-1de4-447b-ae8a-3005a1aa2439 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:38.213040 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-8bba2825-1de4-447b-ae8a-3005a1aa2439 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: 48911604-e8be-4ada-b8aa-e9468ea89514] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:38.220904 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8bba2825-1de4-447b-ae8a-3005a1aa2439 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:38.221349 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8bba2825-1de4-447b-ae8a-3005a1aa2439 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:38.222145 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8bba2825-1de4-447b-ae8a-3005a1aa2439 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:38.222576 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8bba2825-1de4-447b-ae8a-3005a1aa2439 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:38.251412 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-8bba2825-1de4-447b-ae8a-3005a1aa2439 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: 48911604-e8be-4ada-b8aa-e9468ea89514] Going to try to terminate instance {{(pid=118303) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 19:12:38.573569 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-8bba2825-1de4-447b-ae8a-3005a1aa2439 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "DELETE /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514" status: 204 len: 0 microversion: 2.1 time: 0.364583 Aug 03 19:12:38.574162 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 311/617] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 3 19:12:38 2022] DELETE /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 19:12:38.584511 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-b40dd904-69bb-4290-b3b2-d3526d7c3313 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:38.585122 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-b40dd904-69bb-4290-b3b2-d3526d7c3313 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: 48911604-e8be-4ada-b8aa-e9468ea89514] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:38.591292 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b40dd904-69bb-4290-b3b2-d3526d7c3313 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:38.591737 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b40dd904-69bb-4290-b3b2-d3526d7c3313 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:38.592570 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b40dd904-69bb-4290-b3b2-d3526d7c3313 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:38.593008 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b40dd904-69bb-4290-b3b2-d3526d7c3313 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:38.736370 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-b40dd904-69bb-4290-b3b2-d3526d7c3313 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:38.744297 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-b40dd904-69bb-4290-b3b2-d3526d7c3313 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514" status: 200 len: 1670 microversion: 2.1 time: 0.163711 Aug 03 19:12:38.744862 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 307/618] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:12:38 2022] GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514 => generated 1670 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:12:39.767469 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-8a8a1270-7d0a-4423-9e53-f3b29c710d94 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:39.768398 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-8a8a1270-7d0a-4423-9e53-f3b29c710d94 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: 48911604-e8be-4ada-b8aa-e9468ea89514] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:39.775305 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8a8a1270-7d0a-4423-9e53-f3b29c710d94 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:39.775751 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8a8a1270-7d0a-4423-9e53-f3b29c710d94 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:39.776521 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8a8a1270-7d0a-4423-9e53-f3b29c710d94 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:39.776958 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8a8a1270-7d0a-4423-9e53-f3b29c710d94 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:39.922977 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-8a8a1270-7d0a-4423-9e53-f3b29c710d94 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:39.932987 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-8a8a1270-7d0a-4423-9e53-f3b29c710d94 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514" status: 200 len: 1670 microversion: 2.1 time: 0.170185 Aug 03 19:12:39.933949 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 312/619] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:12:39 2022] GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514 => generated 1670 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:12:40.958116 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-3491ecce-5a3a-4bda-afda-0bf7112a1a12 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:40.958730 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-3491ecce-5a3a-4bda-afda-0bf7112a1a12 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: 48911604-e8be-4ada-b8aa-e9468ea89514] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:40.965432 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3491ecce-5a3a-4bda-afda-0bf7112a1a12 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:40.965882 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3491ecce-5a3a-4bda-afda-0bf7112a1a12 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:40.966661 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3491ecce-5a3a-4bda-afda-0bf7112a1a12 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:40.967132 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3491ecce-5a3a-4bda-afda-0bf7112a1a12 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:40.997154 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-ff40b0a4-4004-4e1d-acb0-6285071961cf tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:12:40.999607 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-ff40b0a4-4004-4e1d-acb0-6285071961cf tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:41.017037 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ff40b0a4-4004-4e1d-acb0-6285071961cf tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:41.017721 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ff40b0a4-4004-4e1d-acb0-6285071961cf tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:41.018739 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ff40b0a4-4004-4e1d-acb0-6285071961cf tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:41.019272 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ff40b0a4-4004-4e1d-acb0-6285071961cf tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:41.045597 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.objects.instance [None req-ff40b0a4-4004-4e1d-acb0-6285071961cf tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lazy-loading 'flavor' on Instance uuid 2e21c8ef-c172-41cd-806e-f69f81116b6a {{(pid=118303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:12:41.124040 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-3491ecce-5a3a-4bda-afda-0bf7112a1a12 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:41.133487 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-3491ecce-5a3a-4bda-afda-0bf7112a1a12 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514" status: 200 len: 1670 microversion: 2.1 time: 0.179272 Aug 03 19:12:41.133979 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 308/620] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:12:40 2022] GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514 => generated 1670 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:12:41.592474 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-ff40b0a4-4004-4e1d-acb0-6285071961cf tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "POST /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a/action" status: 202 len: 0 microversion: 2.20 time: 0.599155 Aug 03 19:12:41.593209 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 313/621] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 3 19:12:40 2022] POST /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a/action => generated 0 bytes in 601 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 03 19:12:41.606809 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-b7ec9c4b-7684-46eb-abac-c93f54133f8e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:41.608799 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-b7ec9c4b-7684-46eb-abac-c93f54133f8e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:41.618708 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b7ec9c4b-7684-46eb-abac-c93f54133f8e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:41.618708 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b7ec9c4b-7684-46eb-abac-c93f54133f8e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:41.620169 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b7ec9c4b-7684-46eb-abac-c93f54133f8e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:41.620325 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b7ec9c4b-7684-46eb-abac-c93f54133f8e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:41.784063 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-b7ec9c4b-7684-46eb-abac-c93f54133f8e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:41.797767 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-b7ec9c4b-7684-46eb-abac-c93f54133f8e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:41.800066 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-b7ec9c4b-7684-46eb-abac-c93f54133f8e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:41.811793 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-b7ec9c4b-7684-46eb-abac-c93f54133f8e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1721 microversion: 2.20 time: 0.202535 Aug 03 19:12:41.811793 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 309/622] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:12:41 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1721 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:12:42.107578 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [req-c50847dc-88dc-43e6-9a92-f9a4cfb6c554 req-82dee3a6-c954-42c7-a792-96e2bc548b89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48911604-e8be-4ada-b8aa-e9468ea89514", "name": "network-vif-deleted", "tag": "d3a549b7-a15c-44c7-b252-5e841bc23c57"}]} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:12:42.122315 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-c50847dc-88dc-43e6-9a92-f9a4cfb6c554 req-82dee3a6-c954-42c7-a792-96e2bc548b89 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:42.122909 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-c50847dc-88dc-43e6-9a92-f9a4cfb6c554 req-82dee3a6-c954-42c7-a792-96e2bc548b89 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:42.135779 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.compute.server_external_events [req-c50847dc-88dc-43e6-9a92-f9a4cfb6c554 req-82dee3a6-c954-42c7-a792-96e2bc548b89 service nova] Creating event network-vif-deleted:d3a549b7-a15c-44c7-b252-5e841bc23c57 for instance 48911604-e8be-4ada-b8aa-e9468ea89514 on hv-cinder-85202 Aug 03 19:12:42.140639 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [req-c50847dc-88dc-43e6-9a92-f9a4cfb6c554 req-82dee3a6-c954-42c7-a792-96e2bc548b89 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037495 Aug 03 19:12:42.142122 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 314/623] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:12:42.155427 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-21a3eea3-4e0b-4c4f-bb6d-751ca931c99d tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:42.156248 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-21a3eea3-4e0b-4c4f-bb6d-751ca931c99d tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: 48911604-e8be-4ada-b8aa-e9468ea89514] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:42.164161 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-21a3eea3-4e0b-4c4f-bb6d-751ca931c99d tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:42.164624 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-21a3eea3-4e0b-4c4f-bb6d-751ca931c99d tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:42.165442 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-21a3eea3-4e0b-4c4f-bb6d-751ca931c99d tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:42.165961 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-21a3eea3-4e0b-4c4f-bb6d-751ca931c99d tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:42.298517 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-21a3eea3-4e0b-4c4f-bb6d-751ca931c99d tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb68ecd7a9240948d6b5983f280e649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6df5e1251345209a0de754a734e8ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:42.311159 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-21a3eea3-4e0b-4c4f-bb6d-751ca931c99d tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514" status: 200 len: 1604 microversion: 2.1 time: 0.159919 Aug 03 19:12:42.314393 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 310/624] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:12:42 2022] GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514 => generated 1604 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:12:42.829066 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-3ec2cbbd-5ba3-439f-992e-0c838996b7c7 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:42.829763 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-3ec2cbbd-5ba3-439f-992e-0c838996b7c7 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:42.836957 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3ec2cbbd-5ba3-439f-992e-0c838996b7c7 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:42.839045 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3ec2cbbd-5ba3-439f-992e-0c838996b7c7 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:42.839045 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3ec2cbbd-5ba3-439f-992e-0c838996b7c7 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:42.839045 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3ec2cbbd-5ba3-439f-992e-0c838996b7c7 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:43.000175 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-3ec2cbbd-5ba3-439f-992e-0c838996b7c7 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:43.009683 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-3ec2cbbd-5ba3-439f-992e-0c838996b7c7 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:43.012132 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-3ec2cbbd-5ba3-439f-992e-0c838996b7c7 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:43.014279 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-3ec2cbbd-5ba3-439f-992e-0c838996b7c7 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1721 microversion: 2.20 time: 0.189462 Aug 03 19:12:43.015353 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 315/625] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:12:42 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:12:43.334906 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-447eae6d-ea42-4f62-9d7e-4bdaab9de1ab tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:43.335475 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-447eae6d-ea42-4f62-9d7e-4bdaab9de1ab tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: 48911604-e8be-4ada-b8aa-e9468ea89514] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:43.341880 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-447eae6d-ea42-4f62-9d7e-4bdaab9de1ab tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:43.342325 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-447eae6d-ea42-4f62-9d7e-4bdaab9de1ab tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:43.343129 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-447eae6d-ea42-4f62-9d7e-4bdaab9de1ab tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:43.343563 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-447eae6d-ea42-4f62-9d7e-4bdaab9de1ab tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:43.359150 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.wsgi [None req-447eae6d-ea42-4f62-9d7e-4bdaab9de1ab tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] HTTP exception thrown: Instance 48911604-e8be-4ada-b8aa-e9468ea89514 could not be found. Aug 03 19:12:43.360829 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-447eae6d-ea42-4f62-9d7e-4bdaab9de1ab tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Request method failure captured: Aug 03 19:12:43.360829 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: request: GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514 HTTP/1.1 Aug 03 19:12:43.360829 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept: application/json Aug 03 19:12:43.360829 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept-Encoding: identity Aug 03 19:12:43.360829 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Connection: close Aug 03 19:12:43.360829 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Length: 0 Aug 03 19:12:43.360829 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Type: application/json Aug 03 19:12:43.360829 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Host: 10.222.0.77 Aug 03 19:12:43.360829 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Openstack-System-Scope: None Aug 03 19:12:43.360829 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: User-Agent: python-urllib3/1.26.11 Aug 03 19:12:43.360829 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Auth-Token: gAAAAABi6sZqChsFozggvh0Km-XJ6YDoKUPqx1afjEMs7y-tj_7Q51D0wQUEbmpk5edLz2agtrNzJCwCFcC47j4GzEGtQH4ucz5TBNRprW7Old2AJZW3b17ewEIW-1AELKEvZhRJF16VeljjlGAHIXRaYq0YPHvVTSnnIbe0wEnrS9nCOvLFb10 Aug 03 19:12:43.360829 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Id: None Aug 03 19:12:43.360829 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Name: None Aug 03 19:12:43.360829 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Identity-Status: Confirmed Aug 03 19:12:43.360829 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Is-Admin-Project: True Aug 03 19:12:43.360829 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Id: default Aug 03 19:12:43.360829 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Name: Default Aug 03 19:12:43.360829 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Id: 7d6df5e1251345209a0de754a734e8ec Aug 03 19:12:43.360829 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Name: tempest-AttachVolumeTestJSON-154589076 Aug 03 19:12:43.360829 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Role: reader,member Aug 03 19:12:43.360829 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Roles: reader,member Aug 03 19:12:43.362452 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_7d6df5e1251345209a0de754a734e8ec", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/7d6df5e1251345209a0de754a734e8ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/7d6df5e1251345209a0de754a734e8ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/7d6df5e1251345209a0de754a734e8ec"}]}] Aug 03 19:12:43.362452 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant: tempest-AttachVolumeTestJSON-154589076 Aug 03 19:12:43.362452 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Id: 7d6df5e1251345209a0de754a734e8ec Aug 03 19:12:43.362452 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Name: tempest-AttachVolumeTestJSON-154589076 Aug 03 19:12:43.362452 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User: tempest-AttachVolumeTestJSON-154589076-project Aug 03 19:12:43.362452 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Id: default Aug 03 19:12:43.362452 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Name: Default Aug 03 19:12:43.362452 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Id: 4fb68ecd7a9240948d6b5983f280e649 Aug 03 19:12:43.362452 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Name: tempest-AttachVolumeTestJSON-154589076-project Aug 03 19:12:43.362452 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: method: > Aug 03 19:12:43.362452 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: exception: Instance 48911604-e8be-4ada-b8aa-e9468ea89514 could not be found. Aug 03 19:12:43.362452 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: action_args: {'id': '48911604-e8be-4ada-b8aa-e9468ea89514'} Aug 03 19:12:43.363432 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:12:43.363432 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:12:43.363432 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:12:43.363432 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:12:43.363432 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:12:43.363432 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:12:43.363432 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:12:43.363432 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:12:43.363432 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:12:43.363432 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:12:43.363432 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48911604-e8be-4ada-b8aa-e9468ea89514 could not be found. Aug 03 19:12:43.363432 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:12:43.363432 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:12:43.363432 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:12:43.363432 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:12:43.363432 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:12:43.363432 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:12:43.363432 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:12:43.363432 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:12:43.363432 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:12:43.365012 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:12:43.365012 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:12:43.365012 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:12:43.365012 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:12:43.365012 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:12:43.365012 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:12:43.365012 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:12:43.365012 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48911604-e8be-4ada-b8aa-e9468ea89514 could not be found. Aug 03 19:12:43.365012 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:12:43.365012 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:12:43.365012 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:12:43.365012 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:12:43.365012 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:12:43.365012 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:12:43.365012 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:12:43.365012 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:12:43.365012 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48911604-e8be-4ada-b8aa-e9468ea89514 could not be found. Aug 03 19:12:43.365012 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:12:43.366391 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-447eae6d-ea42-4f62-9d7e-4bdaab9de1ab tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Returning 404 to user: Instance 48911604-e8be-4ada-b8aa-e9468ea89514 could not be found. {{(pid=118302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:12:43.366391 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-447eae6d-ea42-4f62-9d7e-4bdaab9de1ab tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514" status: 404 len: 111 microversion: 2.1 time: 0.033298 Aug 03 19:12:43.366391 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 311/626] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:12:43 2022] GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:12:43.381096 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-be5e884f-8bdb-4e5a-9aa9-571147752398 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '.version_select at 0x7f47862375e0>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:43.495758 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-be5e884f-8bdb-4e5a-9aa9-571147752398 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-472322774" status: 202 len: 0 microversion: 2.1 time: 0.126327 Aug 03 19:12:43.496341 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 316/627] 10.222.0.77 () {58 vars in 1218 bytes} [Wed Aug 3 19:12:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-472322774 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 19:12:44.042193 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-9811cd1c-d9b6-417b-8332-31016ca89136 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:44.042798 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-9811cd1c-d9b6-417b-8332-31016ca89136 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:44.050237 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9811cd1c-d9b6-417b-8332-31016ca89136 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:44.050695 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9811cd1c-d9b6-417b-8332-31016ca89136 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:44.051506 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9811cd1c-d9b6-417b-8332-31016ca89136 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:44.051938 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9811cd1c-d9b6-417b-8332-31016ca89136 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:44.192753 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-9811cd1c-d9b6-417b-8332-31016ca89136 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:44.201290 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-9811cd1c-d9b6-417b-8332-31016ca89136 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:44.202812 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-9811cd1c-d9b6-417b-8332-31016ca89136 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:44.204077 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-9811cd1c-d9b6-417b-8332-31016ca89136 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1721 microversion: 2.20 time: 0.166090 Aug 03 19:12:44.208911 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 312/628] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:12:44 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:12:45.228640 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-6f5900b2-34df-412f-af2b-5afdbf86893c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:45.229306 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-6f5900b2-34df-412f-af2b-5afdbf86893c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:45.236932 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6f5900b2-34df-412f-af2b-5afdbf86893c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:45.237390 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6f5900b2-34df-412f-af2b-5afdbf86893c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:45.238326 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6f5900b2-34df-412f-af2b-5afdbf86893c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:45.238758 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6f5900b2-34df-412f-af2b-5afdbf86893c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:45.381485 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-6f5900b2-34df-412f-af2b-5afdbf86893c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:45.389793 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-6f5900b2-34df-412f-af2b-5afdbf86893c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:45.391338 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-6f5900b2-34df-412f-af2b-5afdbf86893c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:45.392610 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-6f5900b2-34df-412f-af2b-5afdbf86893c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1721 microversion: 2.20 time: 0.169202 Aug 03 19:12:45.393340 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 317/629] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:12:45 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:12:46.415719 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-6ace74a4-dc15-4c95-a0ea-2fbfa17be4cf tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:46.416601 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-6ace74a4-dc15-4c95-a0ea-2fbfa17be4cf tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:46.425933 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-6ace74a4-dc15-4c95-a0ea-2fbfa17be4cf tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:46.426458 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-6ace74a4-dc15-4c95-a0ea-2fbfa17be4cf tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:46.427299 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-6ace74a4-dc15-4c95-a0ea-2fbfa17be4cf tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:46.427733 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-6ace74a4-dc15-4c95-a0ea-2fbfa17be4cf tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:46.566397 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-6ace74a4-dc15-4c95-a0ea-2fbfa17be4cf tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:46.575813 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-6ace74a4-dc15-4c95-a0ea-2fbfa17be4cf tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:46.577358 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-6ace74a4-dc15-4c95-a0ea-2fbfa17be4cf tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:46.578586 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-6ace74a4-dc15-4c95-a0ea-2fbfa17be4cf tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1721 microversion: 2.20 time: 0.166781 Aug 03 19:12:46.579181 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 313/630] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:12:46 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:12:46.925454 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-ab57c876-be63-49c6-81ee-4d38acaf2214 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:46.926026 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-ab57c876-be63-49c6-81ee-4d38acaf2214 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: 48911604-e8be-4ada-b8aa-e9468ea89514] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:46.932748 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ab57c876-be63-49c6-81ee-4d38acaf2214 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:46.933194 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ab57c876-be63-49c6-81ee-4d38acaf2214 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:46.933974 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ab57c876-be63-49c6-81ee-4d38acaf2214 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:46.934411 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ab57c876-be63-49c6-81ee-4d38acaf2214 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:46.958902 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.wsgi [None req-ab57c876-be63-49c6-81ee-4d38acaf2214 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] HTTP exception thrown: Instance 48911604-e8be-4ada-b8aa-e9468ea89514 could not be found. Aug 03 19:12:46.962088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-ab57c876-be63-49c6-81ee-4d38acaf2214 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Request method failure captured: Aug 03 19:12:46.962088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: request: DELETE /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514 HTTP/1.1 Aug 03 19:12:46.962088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept: application/json Aug 03 19:12:46.962088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept-Encoding: identity Aug 03 19:12:46.962088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Connection: close Aug 03 19:12:46.962088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Length: 0 Aug 03 19:12:46.962088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Type: application/json Aug 03 19:12:46.962088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Host: 10.222.0.77 Aug 03 19:12:46.962088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Openstack-System-Scope: None Aug 03 19:12:46.962088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: User-Agent: python-urllib3/1.26.11 Aug 03 19:12:46.962088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Auth-Token: gAAAAABi6sZqChsFozggvh0Km-XJ6YDoKUPqx1afjEMs7y-tj_7Q51D0wQUEbmpk5edLz2agtrNzJCwCFcC47j4GzEGtQH4ucz5TBNRprW7Old2AJZW3b17ewEIW-1AELKEvZhRJF16VeljjlGAHIXRaYq0YPHvVTSnnIbe0wEnrS9nCOvLFb10 Aug 03 19:12:46.962088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Id: None Aug 03 19:12:46.962088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Name: None Aug 03 19:12:46.962088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Identity-Status: Confirmed Aug 03 19:12:46.962088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Is-Admin-Project: True Aug 03 19:12:46.962088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Id: default Aug 03 19:12:46.962088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Name: Default Aug 03 19:12:46.962088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Id: 7d6df5e1251345209a0de754a734e8ec Aug 03 19:12:46.962088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Name: tempest-AttachVolumeTestJSON-154589076 Aug 03 19:12:46.962088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Role: reader,member Aug 03 19:12:46.962088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Roles: reader,member Aug 03 19:12:46.963725 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_7d6df5e1251345209a0de754a734e8ec", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/7d6df5e1251345209a0de754a734e8ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/7d6df5e1251345209a0de754a734e8ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/7d6df5e1251345209a0de754a734e8ec"}]}] Aug 03 19:12:46.963725 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant: tempest-AttachVolumeTestJSON-154589076 Aug 03 19:12:46.963725 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Id: 7d6df5e1251345209a0de754a734e8ec Aug 03 19:12:46.963725 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Name: tempest-AttachVolumeTestJSON-154589076 Aug 03 19:12:46.963725 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User: tempest-AttachVolumeTestJSON-154589076-project Aug 03 19:12:46.963725 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Id: default Aug 03 19:12:46.963725 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Name: Default Aug 03 19:12:46.963725 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Id: 4fb68ecd7a9240948d6b5983f280e649 Aug 03 19:12:46.963725 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Name: tempest-AttachVolumeTestJSON-154589076-project Aug 03 19:12:46.963725 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: method: > Aug 03 19:12:46.963725 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: exception: Instance 48911604-e8be-4ada-b8aa-e9468ea89514 could not be found. Aug 03 19:12:46.963725 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: action_args: {'id': '48911604-e8be-4ada-b8aa-e9468ea89514'} Aug 03 19:12:46.964713 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:12:46.964713 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:12:46.964713 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:12:46.964713 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:12:46.964713 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:12:46.964713 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:12:46.964713 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:12:46.964713 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:12:46.964713 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:12:46.964713 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:12:46.964713 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48911604-e8be-4ada-b8aa-e9468ea89514 could not be found. Aug 03 19:12:46.964713 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:12:46.964713 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:12:46.964713 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:12:46.964713 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:12:46.964713 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:12:46.964713 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:12:46.964713 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:12:46.964713 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:12:46.964713 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:12:46.966245 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:12:46.966245 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 19:12:46.966245 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 19:12:46.966245 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 19:12:46.966245 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 19:12:46.966245 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:12:46.966245 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:12:46.966245 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:12:46.966245 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:12:46.966245 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48911604-e8be-4ada-b8aa-e9468ea89514 could not be found. Aug 03 19:12:46.966245 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:12:46.966245 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:12:46.966245 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:12:46.966245 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:12:46.966245 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:12:46.966245 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:12:46.966245 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:12:46.966245 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:12:46.966245 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48911604-e8be-4ada-b8aa-e9468ea89514 could not be found. Aug 03 19:12:46.966245 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:12:46.968304 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-ab57c876-be63-49c6-81ee-4d38acaf2214 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Returning 404 to user: Instance 48911604-e8be-4ada-b8aa-e9468ea89514 could not be found. {{(pid=118303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:12:46.968304 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-ab57c876-be63-49c6-81ee-4d38acaf2214 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "DELETE /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514" status: 404 len: 111 microversion: 2.1 time: 0.043417 Aug 03 19:12:46.968304 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 318/631] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 3 19:12:46 2022] DELETE /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:12:46.974312 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-97a9569d-0a07-41e1-b19b-c6b9e0fb1687 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:46.974928 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-97a9569d-0a07-41e1-b19b-c6b9e0fb1687 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: 48911604-e8be-4ada-b8aa-e9468ea89514] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:46.981777 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-97a9569d-0a07-41e1-b19b-c6b9e0fb1687 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:46.983291 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-97a9569d-0a07-41e1-b19b-c6b9e0fb1687 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:46.983291 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-97a9569d-0a07-41e1-b19b-c6b9e0fb1687 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:46.983776 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-97a9569d-0a07-41e1-b19b-c6b9e0fb1687 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:46.999166 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.wsgi [None req-97a9569d-0a07-41e1-b19b-c6b9e0fb1687 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] HTTP exception thrown: Instance 48911604-e8be-4ada-b8aa-e9468ea89514 could not be found. Aug 03 19:12:47.000707 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-97a9569d-0a07-41e1-b19b-c6b9e0fb1687 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Request method failure captured: Aug 03 19:12:47.000707 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: request: GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514 HTTP/1.1 Aug 03 19:12:47.000707 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept: application/json Aug 03 19:12:47.000707 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept-Encoding: identity Aug 03 19:12:47.000707 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Connection: close Aug 03 19:12:47.000707 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Length: 0 Aug 03 19:12:47.000707 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Type: application/json Aug 03 19:12:47.000707 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Host: 10.222.0.77 Aug 03 19:12:47.000707 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Openstack-System-Scope: None Aug 03 19:12:47.000707 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: User-Agent: python-urllib3/1.26.11 Aug 03 19:12:47.000707 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Auth-Token: gAAAAABi6sZqChsFozggvh0Km-XJ6YDoKUPqx1afjEMs7y-tj_7Q51D0wQUEbmpk5edLz2agtrNzJCwCFcC47j4GzEGtQH4ucz5TBNRprW7Old2AJZW3b17ewEIW-1AELKEvZhRJF16VeljjlGAHIXRaYq0YPHvVTSnnIbe0wEnrS9nCOvLFb10 Aug 03 19:12:47.000707 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Id: None Aug 03 19:12:47.000707 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Name: None Aug 03 19:12:47.000707 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Identity-Status: Confirmed Aug 03 19:12:47.000707 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Is-Admin-Project: True Aug 03 19:12:47.000707 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Id: default Aug 03 19:12:47.000707 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Name: Default Aug 03 19:12:47.000707 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Id: 7d6df5e1251345209a0de754a734e8ec Aug 03 19:12:47.000707 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Name: tempest-AttachVolumeTestJSON-154589076 Aug 03 19:12:47.000707 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Role: reader,member Aug 03 19:12:47.000707 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Roles: reader,member Aug 03 19:12:47.002182 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_7d6df5e1251345209a0de754a734e8ec", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/7d6df5e1251345209a0de754a734e8ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/7d6df5e1251345209a0de754a734e8ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/7d6df5e1251345209a0de754a734e8ec"}]}] Aug 03 19:12:47.002182 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant: tempest-AttachVolumeTestJSON-154589076 Aug 03 19:12:47.002182 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Id: 7d6df5e1251345209a0de754a734e8ec Aug 03 19:12:47.002182 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Name: tempest-AttachVolumeTestJSON-154589076 Aug 03 19:12:47.002182 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User: tempest-AttachVolumeTestJSON-154589076-project Aug 03 19:12:47.002182 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Id: default Aug 03 19:12:47.002182 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Name: Default Aug 03 19:12:47.002182 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Id: 4fb68ecd7a9240948d6b5983f280e649 Aug 03 19:12:47.002182 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Name: tempest-AttachVolumeTestJSON-154589076-project Aug 03 19:12:47.002182 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: method: > Aug 03 19:12:47.002182 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: exception: Instance 48911604-e8be-4ada-b8aa-e9468ea89514 could not be found. Aug 03 19:12:47.002182 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: action_args: {'id': '48911604-e8be-4ada-b8aa-e9468ea89514'} Aug 03 19:12:47.003022 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:12:47.003022 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:12:47.003022 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:12:47.003022 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:12:47.003022 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:12:47.003022 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:12:47.003022 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:12:47.003022 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:12:47.003022 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:12:47.003022 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:12:47.003022 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48911604-e8be-4ada-b8aa-e9468ea89514 could not be found. Aug 03 19:12:47.003022 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:12:47.003022 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:12:47.003022 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:12:47.003022 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:12:47.003022 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:12:47.003022 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:12:47.003022 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:12:47.003022 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:12:47.003022 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:12:47.004485 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:12:47.004485 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:12:47.004485 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:12:47.004485 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:12:47.004485 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:12:47.004485 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:12:47.004485 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:12:47.004485 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48911604-e8be-4ada-b8aa-e9468ea89514 could not be found. Aug 03 19:12:47.004485 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:12:47.004485 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:12:47.004485 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:12:47.004485 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:12:47.004485 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:12:47.004485 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:12:47.004485 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:12:47.004485 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:12:47.004485 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48911604-e8be-4ada-b8aa-e9468ea89514 could not be found. Aug 03 19:12:47.004485 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:12:47.005781 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-97a9569d-0a07-41e1-b19b-c6b9e0fb1687 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Returning 404 to user: Instance 48911604-e8be-4ada-b8aa-e9468ea89514 could not be found. {{(pid=118302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:12:47.005781 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-97a9569d-0a07-41e1-b19b-c6b9e0fb1687 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514" status: 404 len: 111 microversion: 2.1 time: 0.032339 Aug 03 19:12:47.005781 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 314/632] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:12:46 2022] GET /compute/v2.1/servers/48911604-e8be-4ada-b8aa-e9468ea89514 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:12:47.607248 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-2731229f-722d-4597-9c26-09a95521e5ee tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:47.608018 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-2731229f-722d-4597-9c26-09a95521e5ee tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:47.618305 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2731229f-722d-4597-9c26-09a95521e5ee tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:47.618903 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2731229f-722d-4597-9c26-09a95521e5ee tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:47.620107 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2731229f-722d-4597-9c26-09a95521e5ee tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:47.620707 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2731229f-722d-4597-9c26-09a95521e5ee tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:47.771677 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-2731229f-722d-4597-9c26-09a95521e5ee tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:47.780161 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-2731229f-722d-4597-9c26-09a95521e5ee tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:47.781701 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-2731229f-722d-4597-9c26-09a95521e5ee tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:47.782904 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-2731229f-722d-4597-9c26-09a95521e5ee tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1721 microversion: 2.20 time: 0.183578 Aug 03 19:12:47.783887 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 319/633] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:12:47 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:12:48.309588 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-9fd0987f-586a-42a9-bcea-5c8d3b4b1c5f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:48.310125 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-9fd0987f-586a-42a9-bcea-5c8d3b4b1c5f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:48.317954 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9fd0987f-586a-42a9-bcea-5c8d3b4b1c5f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:48.318414 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9fd0987f-586a-42a9-bcea-5c8d3b4b1c5f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:48.319237 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9fd0987f-586a-42a9-bcea-5c8d3b4b1c5f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:48.319681 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9fd0987f-586a-42a9-bcea-5c8d3b4b1c5f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:48.333798 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.wsgi [None req-9fd0987f-586a-42a9-bcea-5c8d3b4b1c5f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] HTTP exception thrown: Instance cfa72c86-34b7-4dc4-b363-fed702f0cebd could not be found. Aug 03 19:12:48.335402 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-9fd0987f-586a-42a9-bcea-5c8d3b4b1c5f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Request method failure captured: Aug 03 19:12:48.335402 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: request: DELETE /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd HTTP/1.1 Aug 03 19:12:48.335402 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept: application/json Aug 03 19:12:48.335402 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept-Encoding: identity Aug 03 19:12:48.335402 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Connection: close Aug 03 19:12:48.335402 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Length: 0 Aug 03 19:12:48.335402 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Type: application/json Aug 03 19:12:48.335402 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Host: 10.222.0.77 Aug 03 19:12:48.335402 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Openstack-System-Scope: None Aug 03 19:12:48.335402 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: User-Agent: python-urllib3/1.26.11 Aug 03 19:12:48.335402 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Auth-Token: gAAAAABi6sZqChsFozggvh0Km-XJ6YDoKUPqx1afjEMs7y-tj_7Q51D0wQUEbmpk5edLz2agtrNzJCwCFcC47j4GzEGtQH4ucz5TBNRprW7Old2AJZW3b17ewEIW-1AELKEvZhRJF16VeljjlGAHIXRaYq0YPHvVTSnnIbe0wEnrS9nCOvLFb10 Aug 03 19:12:48.335402 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Id: None Aug 03 19:12:48.335402 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Name: None Aug 03 19:12:48.335402 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Identity-Status: Confirmed Aug 03 19:12:48.335402 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Is-Admin-Project: True Aug 03 19:12:48.335402 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Id: default Aug 03 19:12:48.335402 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Name: Default Aug 03 19:12:48.335402 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Id: 7d6df5e1251345209a0de754a734e8ec Aug 03 19:12:48.335402 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Name: tempest-AttachVolumeTestJSON-154589076 Aug 03 19:12:48.335402 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Role: reader,member Aug 03 19:12:48.335402 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Roles: reader,member Aug 03 19:12:48.337012 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_7d6df5e1251345209a0de754a734e8ec", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/7d6df5e1251345209a0de754a734e8ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/7d6df5e1251345209a0de754a734e8ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/7d6df5e1251345209a0de754a734e8ec"}]}] Aug 03 19:12:48.337012 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant: tempest-AttachVolumeTestJSON-154589076 Aug 03 19:12:48.337012 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Id: 7d6df5e1251345209a0de754a734e8ec Aug 03 19:12:48.337012 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Name: tempest-AttachVolumeTestJSON-154589076 Aug 03 19:12:48.337012 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User: tempest-AttachVolumeTestJSON-154589076-project Aug 03 19:12:48.337012 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Id: default Aug 03 19:12:48.337012 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Name: Default Aug 03 19:12:48.337012 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Id: 4fb68ecd7a9240948d6b5983f280e649 Aug 03 19:12:48.337012 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Name: tempest-AttachVolumeTestJSON-154589076-project Aug 03 19:12:48.337012 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: method: > Aug 03 19:12:48.337012 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: exception: Instance cfa72c86-34b7-4dc4-b363-fed702f0cebd could not be found. Aug 03 19:12:48.337012 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: action_args: {'id': 'cfa72c86-34b7-4dc4-b363-fed702f0cebd'} Aug 03 19:12:48.337902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:12:48.337902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:12:48.337902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:12:48.337902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:12:48.337902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:12:48.337902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:12:48.337902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:12:48.337902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:12:48.337902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:12:48.337902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:12:48.337902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfa72c86-34b7-4dc4-b363-fed702f0cebd could not be found. Aug 03 19:12:48.337902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:12:48.337902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:12:48.337902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:12:48.337902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:12:48.337902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:12:48.337902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:12:48.337902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:12:48.337902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:12:48.337902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:12:48.339539 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:12:48.339539 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 19:12:48.339539 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 19:12:48.339539 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 19:12:48.339539 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 19:12:48.339539 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:12:48.339539 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:12:48.339539 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:12:48.339539 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:12:48.339539 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfa72c86-34b7-4dc4-b363-fed702f0cebd could not be found. Aug 03 19:12:48.339539 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:12:48.339539 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:12:48.339539 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:12:48.339539 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:12:48.339539 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:12:48.339539 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:12:48.339539 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:12:48.339539 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:12:48.339539 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfa72c86-34b7-4dc4-b363-fed702f0cebd could not be found. Aug 03 19:12:48.339539 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:12:48.341259 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-9fd0987f-586a-42a9-bcea-5c8d3b4b1c5f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Returning 404 to user: Instance cfa72c86-34b7-4dc4-b363-fed702f0cebd could not be found. {{(pid=118302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:12:48.341259 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-9fd0987f-586a-42a9-bcea-5c8d3b4b1c5f tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "DELETE /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 404 len: 111 microversion: 2.1 time: 0.031111 Aug 03 19:12:48.341259 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 315/634] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 3 19:12:48 2022] DELETE /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:12:48.345629 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-d889b450-4f79-4237-89d9-a34b22950444 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:48.346610 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-d889b450-4f79-4237-89d9-a34b22950444 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] [instance: cfa72c86-34b7-4dc4-b363-fed702f0cebd] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:48.353460 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d889b450-4f79-4237-89d9-a34b22950444 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:48.353950 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d889b450-4f79-4237-89d9-a34b22950444 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:48.354752 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d889b450-4f79-4237-89d9-a34b22950444 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:48.355221 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d889b450-4f79-4237-89d9-a34b22950444 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:48.371471 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.wsgi [None req-d889b450-4f79-4237-89d9-a34b22950444 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] HTTP exception thrown: Instance cfa72c86-34b7-4dc4-b363-fed702f0cebd could not be found. Aug 03 19:12:48.373068 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-d889b450-4f79-4237-89d9-a34b22950444 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Request method failure captured: Aug 03 19:12:48.373068 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: request: GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd HTTP/1.1 Aug 03 19:12:48.373068 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept: application/json Aug 03 19:12:48.373068 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept-Encoding: identity Aug 03 19:12:48.373068 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Connection: close Aug 03 19:12:48.373068 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Length: 0 Aug 03 19:12:48.373068 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Type: application/json Aug 03 19:12:48.373068 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Host: 10.222.0.77 Aug 03 19:12:48.373068 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Openstack-System-Scope: None Aug 03 19:12:48.373068 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: User-Agent: python-urllib3/1.26.11 Aug 03 19:12:48.373068 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Auth-Token: gAAAAABi6sZqChsFozggvh0Km-XJ6YDoKUPqx1afjEMs7y-tj_7Q51D0wQUEbmpk5edLz2agtrNzJCwCFcC47j4GzEGtQH4ucz5TBNRprW7Old2AJZW3b17ewEIW-1AELKEvZhRJF16VeljjlGAHIXRaYq0YPHvVTSnnIbe0wEnrS9nCOvLFb10 Aug 03 19:12:48.373068 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Id: None Aug 03 19:12:48.373068 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Name: None Aug 03 19:12:48.373068 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Identity-Status: Confirmed Aug 03 19:12:48.373068 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Is-Admin-Project: True Aug 03 19:12:48.373068 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Id: default Aug 03 19:12:48.373068 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Name: Default Aug 03 19:12:48.373068 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Id: 7d6df5e1251345209a0de754a734e8ec Aug 03 19:12:48.373068 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Name: tempest-AttachVolumeTestJSON-154589076 Aug 03 19:12:48.373068 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Role: reader,member Aug 03 19:12:48.373068 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Roles: reader,member Aug 03 19:12:48.374615 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_7d6df5e1251345209a0de754a734e8ec", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/7d6df5e1251345209a0de754a734e8ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/7d6df5e1251345209a0de754a734e8ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/7d6df5e1251345209a0de754a734e8ec"}]}] Aug 03 19:12:48.374615 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant: tempest-AttachVolumeTestJSON-154589076 Aug 03 19:12:48.374615 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Id: 7d6df5e1251345209a0de754a734e8ec Aug 03 19:12:48.374615 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Name: tempest-AttachVolumeTestJSON-154589076 Aug 03 19:12:48.374615 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User: tempest-AttachVolumeTestJSON-154589076-project Aug 03 19:12:48.374615 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Id: default Aug 03 19:12:48.374615 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Name: Default Aug 03 19:12:48.374615 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Id: 4fb68ecd7a9240948d6b5983f280e649 Aug 03 19:12:48.374615 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Name: tempest-AttachVolumeTestJSON-154589076-project Aug 03 19:12:48.374615 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: method: > Aug 03 19:12:48.374615 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: exception: Instance cfa72c86-34b7-4dc4-b363-fed702f0cebd could not be found. Aug 03 19:12:48.374615 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: action_args: {'id': 'cfa72c86-34b7-4dc4-b363-fed702f0cebd'} Aug 03 19:12:48.375475 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:12:48.375475 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:12:48.375475 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:12:48.375475 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:12:48.375475 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:12:48.375475 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:12:48.375475 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:12:48.375475 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:12:48.375475 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:12:48.375475 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:12:48.375475 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfa72c86-34b7-4dc4-b363-fed702f0cebd could not be found. Aug 03 19:12:48.375475 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:12:48.375475 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:12:48.375475 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:12:48.375475 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:12:48.375475 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:12:48.375475 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:12:48.375475 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:12:48.375475 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:12:48.375475 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:12:48.376641 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:12:48.376641 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:12:48.376641 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:12:48.376641 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:12:48.376641 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:12:48.376641 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:12:48.376641 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:12:48.376641 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfa72c86-34b7-4dc4-b363-fed702f0cebd could not be found. Aug 03 19:12:48.376641 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:12:48.376641 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:12:48.376641 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:12:48.376641 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:12:48.376641 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:12:48.376641 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:12:48.376641 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:12:48.376641 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:12:48.376641 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfa72c86-34b7-4dc4-b363-fed702f0cebd could not be found. Aug 03 19:12:48.376641 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:12:48.378485 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-d889b450-4f79-4237-89d9-a34b22950444 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] Returning 404 to user: Instance cfa72c86-34b7-4dc4-b363-fed702f0cebd could not be found. {{(pid=118303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:12:48.378485 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-d889b450-4f79-4237-89d9-a34b22950444 tempest-AttachVolumeTestJSON-154589076 tempest-AttachVolumeTestJSON-154589076-project] 10.222.0.77 "GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd" status: 404 len: 111 microversion: 2.1 time: 0.032932 Aug 03 19:12:48.378485 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 320/635] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:12:48 2022] GET /compute/v2.1/servers/cfa72c86-34b7-4dc4-b363-fed702f0cebd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:12:48.806877 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-9f02a911-5667-46f6-ab14-08669d16f983 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:48.807406 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-9f02a911-5667-46f6-ab14-08669d16f983 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:48.813437 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9f02a911-5667-46f6-ab14-08669d16f983 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:48.813891 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9f02a911-5667-46f6-ab14-08669d16f983 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:48.815098 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9f02a911-5667-46f6-ab14-08669d16f983 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:48.815220 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9f02a911-5667-46f6-ab14-08669d16f983 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:48.979273 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-9f02a911-5667-46f6-ab14-08669d16f983 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:48.997460 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-9f02a911-5667-46f6-ab14-08669d16f983 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:48.999391 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-9f02a911-5667-46f6-ab14-08669d16f983 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:49.001701 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-9f02a911-5667-46f6-ab14-08669d16f983 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1721 microversion: 2.20 time: 0.198545 Aug 03 19:12:49.003191 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 316/636] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:12:48 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1721 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:12:49.994279 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-55a168b3-ba23-410f-bb38-6980c5cb2f28 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:49.995419 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-55a168b3-ba23-410f-bb38-6980c5cb2f28 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:50.003575 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-25b57817-2e6d-4726-8b67-d3081f103ca3 req-aef695e5-5e0d-4b64-bea7-40976bac394b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c5a48c7-6f8c-4016-9bdc-257578d6c207", "tag": "a29c7b71-aaab-4c8a-afd0-f196f7f95847"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:12:50.019937 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-55a168b3-ba23-410f-bb38-6980c5cb2f28 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:50.019937 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-55a168b3-ba23-410f-bb38-6980c5cb2f28 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:50.020636 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-55a168b3-ba23-410f-bb38-6980c5cb2f28 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:50.021069 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-55a168b3-ba23-410f-bb38-6980c5cb2f28 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:50.022485 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-25b57817-2e6d-4726-8b67-d3081f103ca3 req-aef695e5-5e0d-4b64-bea7-40976bac394b service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:50.022923 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-25b57817-2e6d-4726-8b67-d3081f103ca3 req-aef695e5-5e0d-4b64-bea7-40976bac394b service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:50.054450 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-25b57817-2e6d-4726-8b67-d3081f103ca3 req-aef695e5-5e0d-4b64-bea7-40976bac394b service nova] Creating event network-changed:a29c7b71-aaab-4c8a-afd0-f196f7f95847 for instance 2c5a48c7-6f8c-4016-9bdc-257578d6c207 on hv-cinder-85202 Aug 03 19:12:50.063789 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-25b57817-2e6d-4726-8b67-d3081f103ca3 req-aef695e5-5e0d-4b64-bea7-40976bac394b service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064182 Aug 03 19:12:50.064020 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:12:50.065110 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 317/637] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:12:50.071306 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-55a168b3-ba23-410f-bb38-6980c5cb2f28 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Going to try to terminate instance {{(pid=118303) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 19:12:50.071929 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-eee6b340-458e-4eb3-b378-61256b49dbe9 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:50.074439 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-eee6b340-458e-4eb3-b378-61256b49dbe9 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:50.079700 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-eee6b340-458e-4eb3-b378-61256b49dbe9 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:50.080374 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-eee6b340-458e-4eb3-b378-61256b49dbe9 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:50.081594 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-eee6b340-458e-4eb3-b378-61256b49dbe9 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:50.082472 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-eee6b340-458e-4eb3-b378-61256b49dbe9 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:50.108331 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:12:50.276342 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-eee6b340-458e-4eb3-b378-61256b49dbe9 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:50.285768 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-eee6b340-458e-4eb3-b378-61256b49dbe9 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:50.288882 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-eee6b340-458e-4eb3-b378-61256b49dbe9 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:50.290357 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-eee6b340-458e-4eb3-b378-61256b49dbe9 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1721 microversion: 2.20 time: 0.223529 Aug 03 19:12:50.291095 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 318/638] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:12:50 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1721 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:12:50.404461 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-55a168b3-ba23-410f-bb38-6980c5cb2f28 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "DELETE /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 204 len: 0 microversion: 2.1 time: 0.413791 Aug 03 19:12:50.405732 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 321/639] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 3 19:12:49 2022] DELETE /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 19:12:50.417721 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-8abd424e-e7e0-4739-94d3-d750a1902b7b tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:50.418730 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-8abd424e-e7e0-4739-94d3-d750a1902b7b tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:50.427210 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8abd424e-e7e0-4739-94d3-d750a1902b7b tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:50.428052 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8abd424e-e7e0-4739-94d3-d750a1902b7b tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:50.429375 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8abd424e-e7e0-4739-94d3-d750a1902b7b tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:50.430063 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8abd424e-e7e0-4739-94d3-d750a1902b7b tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:50.598810 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-8abd424e-e7e0-4739-94d3-d750a1902b7b tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:50.612872 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-8abd424e-e7e0-4739-94d3-d750a1902b7b tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1568 microversion: 2.1 time: 0.200074 Aug 03 19:12:50.613893 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 319/640] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:12:50 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1568 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:12:51.314398 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-ffc05c4f-05c0-47a6-9e20-6fd81bd2087f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:51.315172 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-ffc05c4f-05c0-47a6-9e20-6fd81bd2087f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:51.322510 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ffc05c4f-05c0-47a6-9e20-6fd81bd2087f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:51.322992 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ffc05c4f-05c0-47a6-9e20-6fd81bd2087f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:51.323834 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ffc05c4f-05c0-47a6-9e20-6fd81bd2087f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:51.324273 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ffc05c4f-05c0-47a6-9e20-6fd81bd2087f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:51.468754 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-ffc05c4f-05c0-47a6-9e20-6fd81bd2087f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:51.480781 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-ffc05c4f-05c0-47a6-9e20-6fd81bd2087f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:51.483987 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-ffc05c4f-05c0-47a6-9e20-6fd81bd2087f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:51.485224 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-ffc05c4f-05c0-47a6-9e20-6fd81bd2087f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1721 microversion: 2.20 time: 0.175309 Aug 03 19:12:51.485797 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 322/641] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:12:51 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:12:51.642529 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-2e88b648-9fb8-46a7-b4d2-f1a14bb7d98f tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:51.644337 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-2e88b648-9fb8-46a7-b4d2-f1a14bb7d98f tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:51.656073 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2e88b648-9fb8-46a7-b4d2-f1a14bb7d98f tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:51.657309 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2e88b648-9fb8-46a7-b4d2-f1a14bb7d98f tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:51.660443 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2e88b648-9fb8-46a7-b4d2-f1a14bb7d98f tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:51.661524 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2e88b648-9fb8-46a7-b4d2-f1a14bb7d98f tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:51.981312 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-2e88b648-9fb8-46a7-b4d2-f1a14bb7d98f tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:51.989959 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-2e88b648-9fb8-46a7-b4d2-f1a14bb7d98f tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1568 microversion: 2.1 time: 0.354833 Aug 03 19:12:52.002343 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 320/642] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:12:51 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1568 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:12:52.510081 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-56fad6e1-6db8-4203-aa19-a608e50e56b3 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:52.510890 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-56fad6e1-6db8-4203-aa19-a608e50e56b3 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:52.517895 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-56fad6e1-6db8-4203-aa19-a608e50e56b3 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:52.519080 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-56fad6e1-6db8-4203-aa19-a608e50e56b3 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:52.520016 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-56fad6e1-6db8-4203-aa19-a608e50e56b3 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:52.520571 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-56fad6e1-6db8-4203-aa19-a608e50e56b3 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:52.745054 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-56fad6e1-6db8-4203-aa19-a608e50e56b3 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:52.771702 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-56fad6e1-6db8-4203-aa19-a608e50e56b3 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:52.773556 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-56fad6e1-6db8-4203-aa19-a608e50e56b3 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:52.774747 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-56fad6e1-6db8-4203-aa19-a608e50e56b3 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1721 microversion: 2.20 time: 0.268852 Aug 03 19:12:52.775473 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 323/643] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:12:52 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1721 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 19:12:53.012834 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-527d2fee-ee84-4dbf-b38d-0f039fba4e06 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:53.020085 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-527d2fee-ee84-4dbf-b38d-0f039fba4e06 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:53.020085 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_api:SELECT=43 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:12:53.024544 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-527d2fee-ee84-4dbf-b38d-0f039fba4e06 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:53.024838 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-527d2fee-ee84-4dbf-b38d-0f039fba4e06 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:53.025704 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-527d2fee-ee84-4dbf-b38d-0f039fba4e06 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:53.026178 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-527d2fee-ee84-4dbf-b38d-0f039fba4e06 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:53.042726 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [req-ddb7569d-a3e5-4aa7-a836-f5f9a8b9d6d0 req-44876a6a-46a6-445a-a798-a3ef39dfa642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c5a48c7-6f8c-4016-9bdc-257578d6c207", "name": "network-vif-deleted", "tag": "a29c7b71-aaab-4c8a-afd0-f196f7f95847"}]} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:12:53.057272 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-ddb7569d-a3e5-4aa7-a836-f5f9a8b9d6d0 req-44876a6a-46a6-445a-a798-a3ef39dfa642 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:53.059092 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-ddb7569d-a3e5-4aa7-a836-f5f9a8b9d6d0 req-44876a6a-46a6-445a-a798-a3ef39dfa642 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:53.076205 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.compute.server_external_events [req-ddb7569d-a3e5-4aa7-a836-f5f9a8b9d6d0 req-44876a6a-46a6-445a-a798-a3ef39dfa642 service nova] Creating event network-vif-deleted:a29c7b71-aaab-4c8a-afd0-f196f7f95847 for instance 2c5a48c7-6f8c-4016-9bdc-257578d6c207 on hv-cinder-85202 Aug 03 19:12:53.083172 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [req-ddb7569d-a3e5-4aa7-a836-f5f9a8b9d6d0 req-44876a6a-46a6-445a-a798-a3ef39dfa642 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043945 Aug 03 19:12:53.084835 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 324/644] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 19:12:53.104118 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-527d2fee-ee84-4dbf-b38d-0f039fba4e06 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:53.112058 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-527d2fee-ee84-4dbf-b38d-0f039fba4e06 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1381 microversion: 2.1 time: 0.103282 Aug 03 19:12:53.113061 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 321/645] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:12:53 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1381 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:12:53.801302 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-253a7f45-1683-4aec-999c-9d03a6662c9b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:53.801908 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-253a7f45-1683-4aec-999c-9d03a6662c9b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:53.816809 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-253a7f45-1683-4aec-999c-9d03a6662c9b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:53.817485 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-253a7f45-1683-4aec-999c-9d03a6662c9b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:53.818374 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-253a7f45-1683-4aec-999c-9d03a6662c9b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:53.818923 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-253a7f45-1683-4aec-999c-9d03a6662c9b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:53.970684 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-253a7f45-1683-4aec-999c-9d03a6662c9b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:53.980033 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-253a7f45-1683-4aec-999c-9d03a6662c9b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:53.981535 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-253a7f45-1683-4aec-999c-9d03a6662c9b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:53.982682 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-253a7f45-1683-4aec-999c-9d03a6662c9b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1742 microversion: 2.20 time: 0.187092 Aug 03 19:12:53.983264 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 325/646] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:12:53 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1742 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 19:12:54.134183 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-02c0b547-909d-44bc-a957-068c399565e5 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:54.138992 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-02c0b547-909d-44bc-a957-068c399565e5 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:54.142254 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-02c0b547-909d-44bc-a957-068c399565e5 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:54.142707 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-02c0b547-909d-44bc-a957-068c399565e5 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:54.144285 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-02c0b547-909d-44bc-a957-068c399565e5 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:54.144859 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-02c0b547-909d-44bc-a957-068c399565e5 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:54.177629 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-02c0b547-909d-44bc-a957-068c399565e5 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:54.178066 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-02c0b547-909d-44bc-a957-068c399565e5 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:54.178523 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.objects.instance [None req-02c0b547-909d-44bc-a957-068c399565e5 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lazy-loading 'fault' on Instance uuid 2c5a48c7-6f8c-4016-9bdc-257578d6c207 {{(pid=118302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:12:54.226279 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-02c0b547-909d-44bc-a957-068c399565e5 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7697d104507d47d9be2ff025fb622235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d95b59405174f9689f50fe29d1b4061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:54.234492 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-02c0b547-909d-44bc-a957-068c399565e5 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 200 len: 1224 microversion: 2.1 time: 0.104174 Aug 03 19:12:54.235658 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 322/647] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:12:54 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 1224 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:12:55.006744 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-d60ba903-6e6b-4ed1-a129-934009b58876 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:55.007403 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-d60ba903-6e6b-4ed1-a129-934009b58876 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:55.013457 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d60ba903-6e6b-4ed1-a129-934009b58876 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:55.013907 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d60ba903-6e6b-4ed1-a129-934009b58876 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:55.014682 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d60ba903-6e6b-4ed1-a129-934009b58876 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:55.015157 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d60ba903-6e6b-4ed1-a129-934009b58876 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:55.054244 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-09ce4d79-b1e9-41e6-ac78-7f97393d1bbf tempest-VolumesGetTestJSON-559991594 tempest-VolumesGetTestJSON-559991594-project] Action: 'create', calling method: .version_select at 0x7f47862794c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-571333056", "metadata": {"Type": "work"}}} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:12:55.151557 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-d60ba903-6e6b-4ed1-a129-934009b58876 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:55.160570 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-d60ba903-6e6b-4ed1-a129-934009b58876 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:55.162122 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-d60ba903-6e6b-4ed1-a129-934009b58876 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:55.163381 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-d60ba903-6e6b-4ed1-a129-934009b58876 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1742 microversion: 2.20 time: 0.161337 Aug 03 19:12:55.163940 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 323/648] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:12:55 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1742 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 19:12:55.255461 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-d9d27b79-4e23-49cc-816c-0db24d5d2303 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:55.256088 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-d9d27b79-4e23-49cc-816c-0db24d5d2303 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] [instance: 2c5a48c7-6f8c-4016-9bdc-257578d6c207] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:55.262157 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d9d27b79-4e23-49cc-816c-0db24d5d2303 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:55.262604 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d9d27b79-4e23-49cc-816c-0db24d5d2303 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:55.263436 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d9d27b79-4e23-49cc-816c-0db24d5d2303 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:55.263869 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d9d27b79-4e23-49cc-816c-0db24d5d2303 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:55.277528 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.wsgi [None req-d9d27b79-4e23-49cc-816c-0db24d5d2303 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] HTTP exception thrown: Instance 2c5a48c7-6f8c-4016-9bdc-257578d6c207 could not be found. Aug 03 19:12:55.279191 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-d9d27b79-4e23-49cc-816c-0db24d5d2303 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Request method failure captured: Aug 03 19:12:55.279191 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: request: GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 HTTP/1.1 Aug 03 19:12:55.279191 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept: application/json Aug 03 19:12:55.279191 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept-Encoding: identity Aug 03 19:12:55.279191 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Connection: close Aug 03 19:12:55.279191 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Length: 0 Aug 03 19:12:55.279191 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Type: application/json Aug 03 19:12:55.279191 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Host: 10.222.0.77 Aug 03 19:12:55.279191 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Openstack-System-Scope: None Aug 03 19:12:55.279191 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: User-Agent: python-urllib3/1.26.11 Aug 03 19:12:55.279191 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Auth-Token: gAAAAABi6sdObQEHHMv3tZcDschqvb-WGGq1cScJjIOqShXnFFfMK89g6t-ABSSXajFmftl1PNU_4XUcSG4RsG1REeXHQwpne9M0qmUevf7HFCMY7uBjhLDHdVSY5eJuzalFX3Z9C1z0eJLkVMRFNqcHRqvow9oANxsR3a-3ZDTZZPm5ym7Oxew Aug 03 19:12:55.279191 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Id: None Aug 03 19:12:55.279191 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Name: None Aug 03 19:12:55.279191 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Identity-Status: Confirmed Aug 03 19:12:55.279191 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Is-Admin-Project: True Aug 03 19:12:55.279191 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Id: default Aug 03 19:12:55.279191 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Name: Default Aug 03 19:12:55.279191 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Id: 7d95b59405174f9689f50fe29d1b4061 Aug 03 19:12:55.279191 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Name: tempest-TestShelveInstance-837778978 Aug 03 19:12:55.279191 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Role: reader,member Aug 03 19:12:55.279191 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Roles: reader,member Aug 03 19:12:55.280887 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_7d95b59405174f9689f50fe29d1b4061", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/7d95b59405174f9689f50fe29d1b4061"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/7d95b59405174f9689f50fe29d1b4061"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/7d95b59405174f9689f50fe29d1b4061"}]}] Aug 03 19:12:55.280887 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant: tempest-TestShelveInstance-837778978 Aug 03 19:12:55.280887 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Id: 7d95b59405174f9689f50fe29d1b4061 Aug 03 19:12:55.280887 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Name: tempest-TestShelveInstance-837778978 Aug 03 19:12:55.280887 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User: tempest-TestShelveInstance-837778978-project Aug 03 19:12:55.280887 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Id: default Aug 03 19:12:55.280887 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Name: Default Aug 03 19:12:55.280887 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Id: 7697d104507d47d9be2ff025fb622235 Aug 03 19:12:55.280887 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Name: tempest-TestShelveInstance-837778978-project Aug 03 19:12:55.280887 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: method: > Aug 03 19:12:55.280887 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: exception: Instance 2c5a48c7-6f8c-4016-9bdc-257578d6c207 could not be found. Aug 03 19:12:55.280887 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: action_args: {'id': '2c5a48c7-6f8c-4016-9bdc-257578d6c207'} Aug 03 19:12:55.281964 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:12:55.281964 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:12:55.281964 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:12:55.281964 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:12:55.281964 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:12:55.281964 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:12:55.281964 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:12:55.281964 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:12:55.281964 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:12:55.281964 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:12:55.281964 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c5a48c7-6f8c-4016-9bdc-257578d6c207 could not be found. Aug 03 19:12:55.281964 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:12:55.281964 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:12:55.281964 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:12:55.281964 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:12:55.281964 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:12:55.281964 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:12:55.281964 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:12:55.281964 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:12:55.281964 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:12:55.283685 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:12:55.283685 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:12:55.283685 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:12:55.283685 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:12:55.283685 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:12:55.283685 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:12:55.283685 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:12:55.283685 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c5a48c7-6f8c-4016-9bdc-257578d6c207 could not be found. Aug 03 19:12:55.283685 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:12:55.283685 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:12:55.283685 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:12:55.283685 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:12:55.283685 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:12:55.283685 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:12:55.283685 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:12:55.283685 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:12:55.283685 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c5a48c7-6f8c-4016-9bdc-257578d6c207 could not be found. Aug 03 19:12:55.283685 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:12:55.285957 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-d9d27b79-4e23-49cc-816c-0db24d5d2303 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Returning 404 to user: Instance 2c5a48c7-6f8c-4016-9bdc-257578d6c207 could not be found. {{(pid=118302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:12:55.285957 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-d9d27b79-4e23-49cc-816c-0db24d5d2303 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207" status: 404 len: 111 microversion: 2.1 time: 0.029045 Aug 03 19:12:55.285957 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 324/649] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:12:55 2022] GET /compute/v2.1/servers/2c5a48c7-6f8c-4016-9bdc-257578d6c207 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 19:12:55.522937 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-f015904a-a8fd-46ad-9156-229cc10c1b43 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] Calling method '.version_select at 0x7f478620f1f0>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:55.587495 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-f015904a-a8fd-46ad-9156-229cc10c1b43 tempest-TestShelveInstance-837778978 tempest-TestShelveInstance-837778978-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2102723523" status: 202 len: 0 microversion: 2.1 time: 0.068564 Aug 03 19:12:55.588070 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 325/650] 10.222.0.77 () {58 vars in 1254 bytes} [Wed Aug 3 19:12:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2102723523 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 19:12:55.798133 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-09ce4d79-b1e9-41e6-ac78-7f97393d1bbf tempest-VolumesGetTestJSON-559991594 tempest-VolumesGetTestJSON-559991594-project] 10.222.0.77 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.891861 Aug 03 19:12:55.798756 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 326/651] 10.222.0.77 () {60 vars in 1156 bytes} [Wed Aug 3 19:12:54 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 893 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 03 19:12:55.812858 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-fa75290a-bbf5-4a0b-bdd8-a497657dfb02 tempest-VolumesGetTestJSON-559991594 tempest-VolumesGetTestJSON-559991594-project] Calling method '.version_select at 0x7f478625e1f0>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:55.866848 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-fa75290a-bbf5-4a0b-bdd8-a497657dfb02 tempest-VolumesGetTestJSON-559991594 tempest-VolumesGetTestJSON-559991594-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/1b871b66-5a09-4a6d-bb34-fb710a1aaf69" status: 200 len: 352 microversion: 2.1 time: 0.058246 Aug 03 19:12:55.867441 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 326/652] 10.222.0.77 () {58 vars in 1245 bytes} [Wed Aug 3 19:12:55 2022] GET /compute/v2.1/os-volumes/1b871b66-5a09-4a6d-bb34-fb710a1aaf69 => generated 352 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:12:56.200324 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-57030806-4ed2-4bc4-b57a-6ba4bad2361e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:56.201040 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-57030806-4ed2-4bc4-b57a-6ba4bad2361e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:56.208936 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-57030806-4ed2-4bc4-b57a-6ba4bad2361e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:56.209375 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-57030806-4ed2-4bc4-b57a-6ba4bad2361e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:56.210146 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-57030806-4ed2-4bc4-b57a-6ba4bad2361e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:56.210580 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-57030806-4ed2-4bc4-b57a-6ba4bad2361e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:56.352452 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-57030806-4ed2-4bc4-b57a-6ba4bad2361e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:56.361816 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-57030806-4ed2-4bc4-b57a-6ba4bad2361e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:56.364146 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-57030806-4ed2-4bc4-b57a-6ba4bad2361e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:56.365474 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-57030806-4ed2-4bc4-b57a-6ba4bad2361e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1742 microversion: 2.20 time: 0.169608 Aug 03 19:12:56.366217 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 327/653] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:12:56 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1742 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:12:56.882028 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-38733614-1d65-488e-bedd-bb48b4f5f202 tempest-VolumesGetTestJSON-559991594 tempest-VolumesGetTestJSON-559991594-project] Calling method '.version_select at 0x7f47861f9940>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:57.071200 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-38733614-1d65-488e-bedd-bb48b4f5f202 tempest-VolumesGetTestJSON-559991594 tempest-VolumesGetTestJSON-559991594-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/1b871b66-5a09-4a6d-bb34-fb710a1aaf69" status: 200 len: 352 microversion: 2.1 time: 0.194263 Aug 03 19:12:57.071846 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 327/654] 10.222.0.77 () {58 vars in 1245 bytes} [Wed Aug 3 19:12:56 2022] GET /compute/v2.1/os-volumes/1b871b66-5a09-4a6d-bb34-fb710a1aaf69 => generated 352 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:12:57.393696 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-933091d4-4c69-4d47-9903-8ecf5b26532f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:57.395000 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-933091d4-4c69-4d47-9903-8ecf5b26532f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:57.406568 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-933091d4-4c69-4d47-9903-8ecf5b26532f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:57.407518 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-933091d4-4c69-4d47-9903-8ecf5b26532f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:57.408570 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-933091d4-4c69-4d47-9903-8ecf5b26532f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:57.410907 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-933091d4-4c69-4d47-9903-8ecf5b26532f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:57.658292 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-933091d4-4c69-4d47-9903-8ecf5b26532f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:57.668905 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-933091d4-4c69-4d47-9903-8ecf5b26532f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:57.670587 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-933091d4-4c69-4d47-9903-8ecf5b26532f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:57.671808 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-933091d4-4c69-4d47-9903-8ecf5b26532f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1742 microversion: 2.20 time: 0.283814 Aug 03 19:12:57.679074 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 328/655] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:12:57 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1742 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:12:58.074901 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-2038b0a0-0fe2-4bc6-8a29-6537e9ec5df2 req-e5c80449-9cf2-48a7-a7c9-0797a02416d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e21c8ef-c172-41cd-806e-f69f81116b6a", "name": "network-vif-plugged", "status": "completed", "tag": "5bac2969-4e88-4008-93e1-3408ccc91cbb"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:12:58.085002 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-d348e575-ee90-4abd-9fde-079c7a0686db tempest-VolumesGetTestJSON-559991594 tempest-VolumesGetTestJSON-559991594-project] Calling method '.version_select at 0x7f4786424700>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:58.087226 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-2038b0a0-0fe2-4bc6-8a29-6537e9ec5df2 req-e5c80449-9cf2-48a7-a7c9-0797a02416d3 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:58.088050 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-2038b0a0-0fe2-4bc6-8a29-6537e9ec5df2 req-e5c80449-9cf2-48a7-a7c9-0797a02416d3 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:58.102591 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-2038b0a0-0fe2-4bc6-8a29-6537e9ec5df2 req-e5c80449-9cf2-48a7-a7c9-0797a02416d3 service nova] Creating event network-vif-plugged:5bac2969-4e88-4008-93e1-3408ccc91cbb for instance 2e21c8ef-c172-41cd-806e-f69f81116b6a on hv-cinder-85202 Aug 03 19:12:58.108297 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-2038b0a0-0fe2-4bc6-8a29-6537e9ec5df2 req-e5c80449-9cf2-48a7-a7c9-0797a02416d3 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036900 Aug 03 19:12:58.109979 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 328/656] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 19:12:58.142462 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-d348e575-ee90-4abd-9fde-079c7a0686db tempest-VolumesGetTestJSON-559991594 tempest-VolumesGetTestJSON-559991594-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/1b871b66-5a09-4a6d-bb34-fb710a1aaf69" status: 200 len: 353 microversion: 2.1 time: 0.058369 Aug 03 19:12:58.142462 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 329/657] 10.222.0.77 () {58 vars in 1245 bytes} [Wed Aug 3 19:12:58 2022] GET /compute/v2.1/os-volumes/1b871b66-5a09-4a6d-bb34-fb710a1aaf69 => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 19:12:58.153219 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-91803f99-f891-4501-bcad-d1409b992f88 tempest-VolumesGetTestJSON-559991594 tempest-VolumesGetTestJSON-559991594-project] Calling method '.version_select at 0x7f478620f0d0>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:58.209385 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-91803f99-f891-4501-bcad-d1409b992f88 tempest-VolumesGetTestJSON-559991594 tempest-VolumesGetTestJSON-559991594-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/1b871b66-5a09-4a6d-bb34-fb710a1aaf69" status: 200 len: 353 microversion: 2.1 time: 0.060513 Aug 03 19:12:58.210204 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 329/658] 10.222.0.77 () {58 vars in 1245 bytes} [Wed Aug 3 19:12:58 2022] GET /compute/v2.1/os-volumes/1b871b66-5a09-4a6d-bb34-fb710a1aaf69 => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:12:58.225004 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-d6c8ce43-cfc5-4c5c-b085-b38a73edc096 tempest-VolumesGetTestJSON-559991594 tempest-VolumesGetTestJSON-559991594-project] Calling method '.version_select at 0x7f47862808b0>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:58.415887 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-d6c8ce43-cfc5-4c5c-b085-b38a73edc096 tempest-VolumesGetTestJSON-559991594 tempest-VolumesGetTestJSON-559991594-project] 10.222.0.77 "DELETE /compute/v2.1/os-volumes/1b871b66-5a09-4a6d-bb34-fb710a1aaf69" status: 202 len: 0 microversion: 2.1 time: 0.195960 Aug 03 19:12:58.417084 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 330/659] 10.222.0.77 () {58 vars in 1248 bytes} [Wed Aug 3 19:12:58 2022] DELETE /compute/v2.1/os-volumes/1b871b66-5a09-4a6d-bb34-fb710a1aaf69 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 19:12:58.425415 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-57318c59-8caf-4b00-8379-9d1d230f6b53 tempest-VolumesGetTestJSON-559991594 tempest-VolumesGetTestJSON-559991594-project] Calling method '.version_select at 0x7f4786356280>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:58.477220 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-57318c59-8caf-4b00-8379-9d1d230f6b53 tempest-VolumesGetTestJSON-559991594 tempest-VolumesGetTestJSON-559991594-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/1b871b66-5a09-4a6d-bb34-fb710a1aaf69" status: 200 len: 352 microversion: 2.1 time: 0.055668 Aug 03 19:12:58.479022 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 330/660] 10.222.0.77 () {58 vars in 1245 bytes} [Wed Aug 3 19:12:58 2022] GET /compute/v2.1/os-volumes/1b871b66-5a09-4a6d-bb34-fb710a1aaf69 => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:12:58.697181 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-6a32b83d-52f5-4f6f-9e10-8285febbd87a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:58.698051 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-6a32b83d-52f5-4f6f-9e10-8285febbd87a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:58.714321 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6a32b83d-52f5-4f6f-9e10-8285febbd87a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:58.718634 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6a32b83d-52f5-4f6f-9e10-8285febbd87a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:58.720520 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6a32b83d-52f5-4f6f-9e10-8285febbd87a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:58.720520 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6a32b83d-52f5-4f6f-9e10-8285febbd87a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:58.896451 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-6a32b83d-52f5-4f6f-9e10-8285febbd87a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:58.905749 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-6a32b83d-52f5-4f6f-9e10-8285febbd87a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:58.907361 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-6a32b83d-52f5-4f6f-9e10-8285febbd87a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:58.914685 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-6a32b83d-52f5-4f6f-9e10-8285febbd87a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1737 microversion: 2.20 time: 0.223480 Aug 03 19:12:58.918927 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 331/661] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:12:58 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1737 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:12:59.491712 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-7318fcab-21f6-4644-b5a3-4f6a2e05b4be tempest-VolumesGetTestJSON-559991594 tempest-VolumesGetTestJSON-559991594-project] Calling method '.version_select at 0x7f478625ce50>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:59.521579 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.wsgi [None req-7318fcab-21f6-4644-b5a3-4f6a2e05b4be tempest-VolumesGetTestJSON-559991594 tempest-VolumesGetTestJSON-559991594-project] HTTP exception thrown: Volume 1b871b66-5a09-4a6d-bb34-fb710a1aaf69 could not be found. Aug 03 19:12:59.523893 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-7318fcab-21f6-4644-b5a3-4f6a2e05b4be tempest-VolumesGetTestJSON-559991594 tempest-VolumesGetTestJSON-559991594-project] Request method failure captured: Aug 03 19:12:59.523893 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: request: GET /compute/v2.1/os-volumes/1b871b66-5a09-4a6d-bb34-fb710a1aaf69 HTTP/1.1 Aug 03 19:12:59.523893 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept: application/json Aug 03 19:12:59.523893 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept-Encoding: identity Aug 03 19:12:59.523893 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Connection: close Aug 03 19:12:59.523893 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Length: 0 Aug 03 19:12:59.523893 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Type: application/json Aug 03 19:12:59.523893 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Host: 10.222.0.77 Aug 03 19:12:59.523893 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Openstack-System-Scope: None Aug 03 19:12:59.523893 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: User-Agent: python-urllib3/1.26.11 Aug 03 19:12:59.523893 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Auth-Token: gAAAAABi6si2SCw3OYHikDel8VYWQ5mwj8MBCpEy2lpqM9ED_2aVa9HDNq5XGBfE5wfi9wY3kgvRqnLCQMgIxhUyWCkpW6h_YeS9FfsnLzE9cFobUhl7K7ns3N6zq9D6nO_6Fj2qPLG31sndkUnUrhdXATwxiYjS44h8DRtR4twn3ItNukYTNYs Aug 03 19:12:59.523893 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Id: None Aug 03 19:12:59.523893 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Name: None Aug 03 19:12:59.523893 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Identity-Status: Confirmed Aug 03 19:12:59.523893 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Is-Admin-Project: True Aug 03 19:12:59.523893 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Id: default Aug 03 19:12:59.523893 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Name: Default Aug 03 19:12:59.523893 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Id: 202066c019bc4dbea2065585c23ef9bc Aug 03 19:12:59.523893 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Name: tempest-VolumesGetTestJSON-559991594 Aug 03 19:12:59.523893 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Role: reader,member Aug 03 19:12:59.523893 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Roles: reader,member Aug 03 19:12:59.525638 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_202066c019bc4dbea2065585c23ef9bc", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/202066c019bc4dbea2065585c23ef9bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/202066c019bc4dbea2065585c23ef9bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/202066c019bc4dbea2065585c23ef9bc"}]}] Aug 03 19:12:59.525638 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant: tempest-VolumesGetTestJSON-559991594 Aug 03 19:12:59.525638 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Id: 202066c019bc4dbea2065585c23ef9bc Aug 03 19:12:59.525638 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Name: tempest-VolumesGetTestJSON-559991594 Aug 03 19:12:59.525638 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User: tempest-VolumesGetTestJSON-559991594-project Aug 03 19:12:59.525638 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Id: default Aug 03 19:12:59.525638 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Name: Default Aug 03 19:12:59.525638 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Id: 27bdeab2f4fa494099f4c8ac26be0de2 Aug 03 19:12:59.525638 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Name: tempest-VolumesGetTestJSON-559991594-project Aug 03 19:12:59.525638 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: method: Aug 03 19:12:59.525638 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: exception: Volume 1b871b66-5a09-4a6d-bb34-fb710a1aaf69 could not be found. Aug 03 19:12:59.525638 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: action_args: {'id': '1b871b66-5a09-4a6d-bb34-fb710a1aaf69'} Aug 03 19:12:59.525638 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:12:59.526590 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:12:59.526590 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 19:12:59.526590 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 19:12:59.526590 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 19:12:59.526590 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 19:12:59.526590 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 19:12:59.526590 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 19:12:59.526590 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 19:12:59.526590 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 19:12:59.526590 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 19:12:59.526590 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 19:12:59.526590 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 19:12:59.526590 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 19:12:59.526590 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 19:12:59.526590 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 19:12:59.526590 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1b871b66-5a09-4a6d-bb34-fb710a1aaf69 could not be found. (HTTP 404) (Request-ID: req-aa232f1b-b080-414e-9fff-1865b805b7db) Aug 03 19:12:59.526590 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:12:59.526590 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:12:59.526590 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:12:59.527804 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:12:59.527804 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 03 19:12:59.527804 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 03 19:12:59.527804 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 19:12:59.527804 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 19:12:59.527804 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 19:12:59.527804 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 19:12:59.527804 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 19:12:59.527804 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 19:12:59.527804 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 19:12:59.527804 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 19:12:59.527804 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 19:12:59.527804 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 19:12:59.527804 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 19:12:59.527804 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 19:12:59.527804 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 19:12:59.527804 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 19:12:59.527804 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 19:12:59.527804 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 19:12:59.529202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 19:12:59.529202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 19:12:59.529202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 19:12:59.529202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 19:12:59.529202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1b871b66-5a09-4a6d-bb34-fb710a1aaf69 could not be found. Aug 03 19:12:59.529202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:12:59.529202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:12:59.529202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:12:59.529202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:12:59.529202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:12:59.529202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:12:59.529202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:12:59.529202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:12:59.529202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 19:12:59.529202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 19:12:59.529202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:12:59.529202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:12:59.529202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 03 19:12:59.529202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:12:59.530608 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1b871b66-5a09-4a6d-bb34-fb710a1aaf69 could not be found. Aug 03 19:12:59.530608 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:12:59.530608 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:12:59.530608 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:12:59.530608 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:12:59.530608 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:12:59.530608 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:12:59.530608 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:12:59.530608 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:12:59.530608 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1b871b66-5a09-4a6d-bb34-fb710a1aaf69 could not be found. Aug 03 19:12:59.530608 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:12:59.530608 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-7318fcab-21f6-4644-b5a3-4f6a2e05b4be tempest-VolumesGetTestJSON-559991594 tempest-VolumesGetTestJSON-559991594-project] Returning 404 to user: Volume 1b871b66-5a09-4a6d-bb34-fb710a1aaf69 could not be found. {{(pid=118302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:12:59.530608 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-7318fcab-21f6-4644-b5a3-4f6a2e05b4be tempest-VolumesGetTestJSON-559991594 tempest-VolumesGetTestJSON-559991594-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/1b871b66-5a09-4a6d-bb34-fb710a1aaf69" status: 404 len: 109 microversion: 2.1 time: 0.038744 Aug 03 19:12:59.530608 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 331/662] 10.222.0.77 () {58 vars in 1245 bytes} [Wed Aug 3 19:12:59 2022] GET /compute/v2.1/os-volumes/1b871b66-5a09-4a6d-bb34-fb710a1aaf69 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:12:59.944497 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-3e138651-1d3d-4314-a3cd-42c0a12c3dd2 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:59.945950 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-3e138651-1d3d-4314-a3cd-42c0a12c3dd2 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:59.961216 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3e138651-1d3d-4314-a3cd-42c0a12c3dd2 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:59.965082 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3e138651-1d3d-4314-a3cd-42c0a12c3dd2 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:59.965938 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3e138651-1d3d-4314-a3cd-42c0a12c3dd2 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:59.970554 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3e138651-1d3d-4314-a3cd-42c0a12c3dd2 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:00.276834 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-3e138651-1d3d-4314-a3cd-42c0a12c3dd2 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:00.288336 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-3e138651-1d3d-4314-a3cd-42c0a12c3dd2 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:00.294616 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-3e138651-1d3d-4314-a3cd-42c0a12c3dd2 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:00.299015 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-3e138651-1d3d-4314-a3cd-42c0a12c3dd2 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1737 microversion: 2.20 time: 0.357305 Aug 03 19:13:00.301362 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 332/663] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:12:59 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1737 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:13:01.326288 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-54910ea7-4cb3-4edc-8b7d-b51033f5c16b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:01.327168 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-54910ea7-4cb3-4edc-8b7d-b51033f5c16b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:01.337776 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-54910ea7-4cb3-4edc-8b7d-b51033f5c16b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:01.338329 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-54910ea7-4cb3-4edc-8b7d-b51033f5c16b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:01.342979 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-54910ea7-4cb3-4edc-8b7d-b51033f5c16b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:01.343542 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-54910ea7-4cb3-4edc-8b7d-b51033f5c16b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:01.662434 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-54910ea7-4cb3-4edc-8b7d-b51033f5c16b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:01.686220 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-54910ea7-4cb3-4edc-8b7d-b51033f5c16b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:01.695035 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-54910ea7-4cb3-4edc-8b7d-b51033f5c16b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:01.696719 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-54910ea7-4cb3-4edc-8b7d-b51033f5c16b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1737 microversion: 2.20 time: 0.374286 Aug 03 19:13:01.698794 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 332/664] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:01 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1737 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:13:02.727948 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-8cb1b4ba-4a95-4bcc-b2b3-7292fdf7cf65 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:02.729331 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-8cb1b4ba-4a95-4bcc-b2b3-7292fdf7cf65 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:02.742606 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8cb1b4ba-4a95-4bcc-b2b3-7292fdf7cf65 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:02.744279 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8cb1b4ba-4a95-4bcc-b2b3-7292fdf7cf65 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:02.745294 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8cb1b4ba-4a95-4bcc-b2b3-7292fdf7cf65 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:02.745742 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8cb1b4ba-4a95-4bcc-b2b3-7292fdf7cf65 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:02.836410 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-9755711c-309c-4450-88bf-46e0182ed6ad tempest-VolumesNegativeTest-934035935 tempest-VolumesNegativeTest-934035935-project] Action: 'create', calling method: .version_select at 0x7f4786248430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-985511974", "metadata": {"Type": "work"}}} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:13:02.866626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-9755711c-309c-4450-88bf-46e0182ed6ad tempest-VolumesNegativeTest-934035935 tempest-VolumesNegativeTest-934035935-project] Request method failure captured: Aug 03 19:13:02.866626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 03 19:13:02.866626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept: application/json Aug 03 19:13:02.866626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept-Encoding: identity Aug 03 19:13:02.866626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Connection: close Aug 03 19:13:02.866626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Length: 121 Aug 03 19:13:02.866626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Type: application/json Aug 03 19:13:02.866626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Host: 10.222.0.77 Aug 03 19:13:02.866626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Openstack-System-Scope: None Aug 03 19:13:02.866626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: User-Agent: python-urllib3/1.26.11 Aug 03 19:13:02.866626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Auth-Token: gAAAAABi6si-vtbsffz456685iS9F7atL4o26BsY7gwAxt4hor58-VE0DjD611swd_eGrG1Eg6PC33nfSqd3-IF6WJw4Pvqyw2SWLZnHRM2chJmSn7fKMt08xCeTKCdgKtaG_is_P6GEelROZb5C4vTWjjx4CL1ChnggazCwKbYDiRuqh5IkYts Aug 03 19:13:02.866626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Id: None Aug 03 19:13:02.866626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Name: None Aug 03 19:13:02.866626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Identity-Status: Confirmed Aug 03 19:13:02.866626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Is-Admin-Project: True Aug 03 19:13:02.866626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Id: default Aug 03 19:13:02.866626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Name: Default Aug 03 19:13:02.866626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Id: 206c32af26d44059948b7e22fd2a1260 Aug 03 19:13:02.866626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Name: tempest-VolumesNegativeTest-934035935 Aug 03 19:13:02.866626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Role: reader,member Aug 03 19:13:02.866626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Roles: reader,member Aug 03 19:13:02.869232 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_206c32af26d44059948b7e22fd2a1260", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/206c32af26d44059948b7e22fd2a1260"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/206c32af26d44059948b7e22fd2a1260"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/206c32af26d44059948b7e22fd2a1260"}]}] Aug 03 19:13:02.869232 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant: tempest-VolumesNegativeTest-934035935 Aug 03 19:13:02.869232 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Id: 206c32af26d44059948b7e22fd2a1260 Aug 03 19:13:02.869232 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Name: tempest-VolumesNegativeTest-934035935 Aug 03 19:13:02.869232 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User: tempest-VolumesNegativeTest-934035935-project Aug 03 19:13:02.869232 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Id: default Aug 03 19:13:02.869232 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Name: Default Aug 03 19:13:02.869232 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Id: 363e70c4be784f52a278c9485657bc20 Aug 03 19:13:02.869232 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Name: tempest-VolumesNegativeTest-934035935-project Aug 03 19:13:02.869232 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Aug 03 19:13:02.869232 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-985511974", "metadata": {"Type": "work"}}} Aug 03 19:13:02.869232 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: method: Aug 03 19:13:02.869232 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 03 19:13:02.885203 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-985511974', 'metadata': {'Type': 'work'}}}} Aug 03 19:13:02.885203 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:13:02.885203 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:13:02.885203 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 19:13:02.885203 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 19:13:02.885203 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 19:13:02.885203 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise error Aug 03 19:13:02.885203 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 03 19:13:02.885203 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:13:02.885203 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 03 19:13:02.885203 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 03 19:13:02.885203 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:13:02.885203 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 03 19:13:02.885203 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi '#$%' Aug 03 19:13:02.885203 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:13:02.885203 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:13:02.885203 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:13:02.885203 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:13:02.885203 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:13:02.885203 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:13:02.885203 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:13:02.885203 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:13:02.886922 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 19:13:02.886922 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 19:13:02.886922 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:13:02.886922 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:13:02.886922 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 19:13:02.886922 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 19:13:02.886922 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 19:13:02.886922 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 19:13:02.886922 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 19:13:02.886922 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 19:13:02.886922 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 03 19:13:02.886922 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:13:02.886922 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:13:02.886922 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:13:02.886922 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:13:02.886922 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:13:02.886922 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:13:02.886922 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 19:13:02.886922 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 19:13:02.888377 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 03 19:13:02.888377 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:13:02.888377 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-9755711c-309c-4450-88bf-46e0182ed6ad tempest-VolumesNegativeTest-934035935 tempest-VolumesNegativeTest-934035935-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:13:02.888377 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-9755711c-309c-4450-88bf-46e0182ed6ad tempest-VolumesNegativeTest-934035935 tempest-VolumesNegativeTest-934035935-project] 10.222.0.77 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.268540 Aug 03 19:13:02.888377 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 333/665] 10.222.0.77 () {60 vars in 1156 bytes} [Wed Aug 3 19:13:02 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 270 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 19:13:02.892721 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-9731b371-957a-4cbe-9f9c-ae35dcd7cace tempest-VolumesNegativeTest-934035935 tempest-VolumesNegativeTest-934035935-project] Action: 'create', calling method: .version_select at 0x7f47864dcb80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1717658255", "metadata": {"Type": "work"}}} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:13:02.913147 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-9731b371-957a-4cbe-9f9c-ae35dcd7cace tempest-VolumesNegativeTest-934035935 tempest-VolumesNegativeTest-934035935-project] Request method failure captured: Aug 03 19:13:02.913147 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 03 19:13:02.913147 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept: application/json Aug 03 19:13:02.913147 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept-Encoding: identity Aug 03 19:13:02.913147 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Connection: close Aug 03 19:13:02.913147 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Length: 120 Aug 03 19:13:02.913147 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Type: application/json Aug 03 19:13:02.913147 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Host: 10.222.0.77 Aug 03 19:13:02.913147 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Openstack-System-Scope: None Aug 03 19:13:02.913147 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: User-Agent: python-urllib3/1.26.11 Aug 03 19:13:02.913147 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Auth-Token: gAAAAABi6si-vtbsffz456685iS9F7atL4o26BsY7gwAxt4hor58-VE0DjD611swd_eGrG1Eg6PC33nfSqd3-IF6WJw4Pvqyw2SWLZnHRM2chJmSn7fKMt08xCeTKCdgKtaG_is_P6GEelROZb5C4vTWjjx4CL1ChnggazCwKbYDiRuqh5IkYts Aug 03 19:13:02.913147 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Id: None Aug 03 19:13:02.913147 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Name: None Aug 03 19:13:02.913147 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Identity-Status: Confirmed Aug 03 19:13:02.913147 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Is-Admin-Project: True Aug 03 19:13:02.913147 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Id: default Aug 03 19:13:02.913147 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Name: Default Aug 03 19:13:02.913147 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Id: 206c32af26d44059948b7e22fd2a1260 Aug 03 19:13:02.913147 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Name: tempest-VolumesNegativeTest-934035935 Aug 03 19:13:02.913147 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Role: reader,member Aug 03 19:13:02.913147 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Roles: reader,member Aug 03 19:13:02.914847 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_206c32af26d44059948b7e22fd2a1260", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/206c32af26d44059948b7e22fd2a1260"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/206c32af26d44059948b7e22fd2a1260"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/206c32af26d44059948b7e22fd2a1260"}]}] Aug 03 19:13:02.914847 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant: tempest-VolumesNegativeTest-934035935 Aug 03 19:13:02.914847 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Id: 206c32af26d44059948b7e22fd2a1260 Aug 03 19:13:02.914847 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Name: tempest-VolumesNegativeTest-934035935 Aug 03 19:13:02.914847 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User: tempest-VolumesNegativeTest-934035935-project Aug 03 19:13:02.914847 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Id: default Aug 03 19:13:02.914847 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Name: Default Aug 03 19:13:02.914847 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Id: 363e70c4be784f52a278c9485657bc20 Aug 03 19:13:02.914847 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Name: tempest-VolumesNegativeTest-934035935-project Aug 03 19:13:02.914847 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Aug 03 19:13:02.914847 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1717658255", "metadata": {"Type": "work"}}} Aug 03 19:13:02.914847 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: method: Aug 03 19:13:02.914847 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 03 19:13:02.915896 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1717658255', 'metadata': {'Type': 'work'}}}} Aug 03 19:13:02.915896 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:13:02.915896 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:13:02.915896 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 19:13:02.915896 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 19:13:02.915896 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 19:13:02.915896 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise error Aug 03 19:13:02.915896 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 03 19:13:02.915896 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:13:02.915896 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 03 19:13:02.915896 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 03 19:13:02.915896 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:13:02.915896 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 03 19:13:02.915896 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi '0' Aug 03 19:13:02.915896 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:13:02.915896 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:13:02.915896 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:13:02.915896 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:13:02.915896 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:13:02.915896 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:13:02.915896 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:13:02.915896 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:13:02.917709 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 19:13:02.917709 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 19:13:02.917709 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:13:02.917709 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:13:02.917709 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 19:13:02.917709 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 19:13:02.917709 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 19:13:02.917709 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 19:13:02.917709 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 19:13:02.917709 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 19:13:02.917709 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 03 19:13:02.917709 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:13:02.917709 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:13:02.917709 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:13:02.917709 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:13:02.917709 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:13:02.917709 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:13:02.917709 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 19:13:02.917709 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 19:13:02.919065 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 03 19:13:02.919065 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:13:02.919065 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-9731b371-957a-4cbe-9f9c-ae35dcd7cace tempest-VolumesNegativeTest-934035935 tempest-VolumesNegativeTest-934035935-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:13:02.919065 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-9731b371-957a-4cbe-9f9c-ae35dcd7cace tempest-VolumesNegativeTest-934035935 tempest-VolumesNegativeTest-934035935-project] 10.222.0.77 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.026097 Aug 03 19:13:02.919921 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 334/666] 10.222.0.77 () {60 vars in 1156 bytes} [Wed Aug 3 19:13:02 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 19:13:02.937085 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-dc417d2b-ca38-4a00-813a-0febb7025533 tempest-VolumesNegativeTest-934035935 tempest-VolumesNegativeTest-934035935-project] Action: 'create', calling method: .version_select at 0x7f47862481f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1353229499", "metadata": {"Type": "work"}}} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:13:02.941501 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-dc417d2b-ca38-4a00-813a-0febb7025533 tempest-VolumesNegativeTest-934035935 tempest-VolumesNegativeTest-934035935-project] Request method failure captured: Aug 03 19:13:02.941501 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 03 19:13:02.941501 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept: application/json Aug 03 19:13:02.941501 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept-Encoding: identity Aug 03 19:13:02.941501 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Connection: close Aug 03 19:13:02.941501 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Length: 119 Aug 03 19:13:02.941501 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Type: application/json Aug 03 19:13:02.941501 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Host: 10.222.0.77 Aug 03 19:13:02.941501 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Openstack-System-Scope: None Aug 03 19:13:02.941501 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: User-Agent: python-urllib3/1.26.11 Aug 03 19:13:02.941501 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Auth-Token: gAAAAABi6si-vtbsffz456685iS9F7atL4o26BsY7gwAxt4hor58-VE0DjD611swd_eGrG1Eg6PC33nfSqd3-IF6WJw4Pvqyw2SWLZnHRM2chJmSn7fKMt08xCeTKCdgKtaG_is_P6GEelROZb5C4vTWjjx4CL1ChnggazCwKbYDiRuqh5IkYts Aug 03 19:13:02.941501 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Id: None Aug 03 19:13:02.941501 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Name: None Aug 03 19:13:02.941501 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Identity-Status: Confirmed Aug 03 19:13:02.941501 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Is-Admin-Project: True Aug 03 19:13:02.941501 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Id: default Aug 03 19:13:02.941501 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Name: Default Aug 03 19:13:02.941501 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Id: 206c32af26d44059948b7e22fd2a1260 Aug 03 19:13:02.941501 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Name: tempest-VolumesNegativeTest-934035935 Aug 03 19:13:02.941501 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Role: reader,member Aug 03 19:13:02.941501 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Roles: reader,member Aug 03 19:13:02.943091 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_206c32af26d44059948b7e22fd2a1260", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/206c32af26d44059948b7e22fd2a1260"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/206c32af26d44059948b7e22fd2a1260"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/206c32af26d44059948b7e22fd2a1260"}]}] Aug 03 19:13:02.943091 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant: tempest-VolumesNegativeTest-934035935 Aug 03 19:13:02.943091 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Id: 206c32af26d44059948b7e22fd2a1260 Aug 03 19:13:02.943091 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Name: tempest-VolumesNegativeTest-934035935 Aug 03 19:13:02.943091 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User: tempest-VolumesNegativeTest-934035935-project Aug 03 19:13:02.943091 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Id: default Aug 03 19:13:02.943091 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Name: Default Aug 03 19:13:02.943091 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Id: 363e70c4be784f52a278c9485657bc20 Aug 03 19:13:02.943091 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Name: tempest-VolumesNegativeTest-934035935-project Aug 03 19:13:02.943091 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Aug 03 19:13:02.943091 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1353229499", "metadata": {"Type": "work"}}} Aug 03 19:13:02.943091 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: method: Aug 03 19:13:02.943091 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 03 19:13:02.944070 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1353229499', 'metadata': {'Type': 'work'}}}} Aug 03 19:13:02.944070 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:13:02.944070 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:13:02.944070 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 19:13:02.944070 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 19:13:02.944070 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 19:13:02.944070 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise error Aug 03 19:13:02.944070 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 03 19:13:02.944070 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:13:02.944070 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 03 19:13:02.944070 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 03 19:13:02.944070 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:13:02.944070 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 03 19:13:02.944070 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi '' Aug 03 19:13:02.944070 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:13:02.944070 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:13:02.944070 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:13:02.944070 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:13:02.944070 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:13:02.944070 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:13:02.944070 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:13:02.944070 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:13:02.945627 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 19:13:02.945627 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 19:13:02.945627 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:13:02.945627 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:13:02.945627 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 19:13:02.945627 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 19:13:02.945627 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 19:13:02.945627 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 19:13:02.945627 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 19:13:02.945627 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 19:13:02.945627 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 03 19:13:02.945627 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:13:02.945627 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:13:02.945627 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:13:02.945627 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:13:02.945627 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:13:02.945627 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:13:02.945627 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 19:13:02.945627 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 19:13:02.946975 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 03 19:13:02.946975 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:13:02.946975 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-dc417d2b-ca38-4a00-813a-0febb7025533 tempest-VolumesNegativeTest-934035935 tempest-VolumesNegativeTest-934035935-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:13:02.946975 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-dc417d2b-ca38-4a00-813a-0febb7025533 tempest-VolumesNegativeTest-934035935 tempest-VolumesNegativeTest-934035935-project] 10.222.0.77 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.016268 Aug 03 19:13:02.961258 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 335/667] 10.222.0.77 () {60 vars in 1156 bytes} [Wed Aug 3 19:13:02 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 19:13:02.975929 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-3a80e774-8ce3-4bbc-a0d3-1df2ea1a5dbd tempest-VolumesNegativeTest-934035935 tempest-VolumesNegativeTest-934035935-project] Calling method '.version_select at 0x7f4786490ca0>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:03.038866 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.wsgi [None req-3a80e774-8ce3-4bbc-a0d3-1df2ea1a5dbd tempest-VolumesNegativeTest-934035935 tempest-VolumesNegativeTest-934035935-project] HTTP exception thrown: Volume tempest-invalid-341190051 could not be found. Aug 03 19:13:03.040930 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-3a80e774-8ce3-4bbc-a0d3-1df2ea1a5dbd tempest-VolumesNegativeTest-934035935 tempest-VolumesNegativeTest-934035935-project] Request method failure captured: Aug 03 19:13:03.040930 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-341190051 HTTP/1.1 Aug 03 19:13:03.040930 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept: application/json Aug 03 19:13:03.040930 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept-Encoding: identity Aug 03 19:13:03.040930 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Connection: close Aug 03 19:13:03.040930 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Length: 0 Aug 03 19:13:03.040930 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Type: application/json Aug 03 19:13:03.040930 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Host: 10.222.0.77 Aug 03 19:13:03.040930 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Openstack-System-Scope: None Aug 03 19:13:03.040930 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: User-Agent: python-urllib3/1.26.11 Aug 03 19:13:03.040930 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Auth-Token: gAAAAABi6si-vtbsffz456685iS9F7atL4o26BsY7gwAxt4hor58-VE0DjD611swd_eGrG1Eg6PC33nfSqd3-IF6WJw4Pvqyw2SWLZnHRM2chJmSn7fKMt08xCeTKCdgKtaG_is_P6GEelROZb5C4vTWjjx4CL1ChnggazCwKbYDiRuqh5IkYts Aug 03 19:13:03.040930 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Id: None Aug 03 19:13:03.040930 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Name: None Aug 03 19:13:03.040930 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Identity-Status: Confirmed Aug 03 19:13:03.040930 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Is-Admin-Project: True Aug 03 19:13:03.040930 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Id: default Aug 03 19:13:03.040930 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Name: Default Aug 03 19:13:03.040930 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Id: 206c32af26d44059948b7e22fd2a1260 Aug 03 19:13:03.040930 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Name: tempest-VolumesNegativeTest-934035935 Aug 03 19:13:03.040930 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Role: reader,member Aug 03 19:13:03.040930 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Roles: reader,member Aug 03 19:13:03.042774 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_206c32af26d44059948b7e22fd2a1260", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/206c32af26d44059948b7e22fd2a1260"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/206c32af26d44059948b7e22fd2a1260"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/206c32af26d44059948b7e22fd2a1260"}]}] Aug 03 19:13:03.042774 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant: tempest-VolumesNegativeTest-934035935 Aug 03 19:13:03.042774 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Id: 206c32af26d44059948b7e22fd2a1260 Aug 03 19:13:03.042774 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Name: tempest-VolumesNegativeTest-934035935 Aug 03 19:13:03.042774 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User: tempest-VolumesNegativeTest-934035935-project Aug 03 19:13:03.042774 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Id: default Aug 03 19:13:03.042774 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Name: Default Aug 03 19:13:03.042774 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Id: 363e70c4be784f52a278c9485657bc20 Aug 03 19:13:03.042774 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Name: tempest-VolumesNegativeTest-934035935-project Aug 03 19:13:03.042774 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: method: Aug 03 19:13:03.042774 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: exception: Volume tempest-invalid-341190051 could not be found. Aug 03 19:13:03.042774 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: action_args: {'id': 'tempest-invalid-341190051'} Aug 03 19:13:03.042774 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:13:03.043869 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:13:03.043869 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 19:13:03.043869 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 19:13:03.043869 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 19:13:03.043869 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 19:13:03.043869 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 19:13:03.043869 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 19:13:03.043869 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 19:13:03.043869 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 19:13:03.043869 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 19:13:03.043869 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 19:13:03.043869 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 19:13:03.043869 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 19:13:03.043869 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 19:13:03.043869 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 19:13:03.043869 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-341190051 could not be found. (HTTP 404) (Request-ID: req-fefb0353-2ed6-4206-8470-4b9f267d328b) Aug 03 19:13:03.043869 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:13:03.043869 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:13:03.043869 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:13:03.045257 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:13:03.045257 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 03 19:13:03.045257 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 03 19:13:03.045257 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 19:13:03.045257 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 19:13:03.045257 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 19:13:03.045257 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 19:13:03.045257 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 19:13:03.045257 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 19:13:03.045257 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 19:13:03.045257 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 19:13:03.045257 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 19:13:03.045257 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 19:13:03.045257 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 19:13:03.045257 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 19:13:03.045257 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 19:13:03.045257 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 19:13:03.045257 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 19:13:03.045257 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 19:13:03.046600 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 19:13:03.046600 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 19:13:03.046600 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 19:13:03.046600 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 19:13:03.046600 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-341190051 could not be found. Aug 03 19:13:03.046600 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:13:03.046600 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:13:03.046600 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:13:03.046600 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:13:03.046600 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:13:03.046600 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:13:03.046600 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:13:03.046600 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:13:03.046600 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 19:13:03.046600 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 19:13:03.046600 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:13:03.046600 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:13:03.046600 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 03 19:13:03.046600 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:13:03.046600 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-341190051 could not be found. Aug 03 19:13:03.048792 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:13:03.048792 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:13:03.048792 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:13:03.048792 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:13:03.048792 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:13:03.048792 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:13:03.048792 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:13:03.048792 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:13:03.048792 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-341190051 could not be found. Aug 03 19:13:03.048792 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:13:03.048792 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-3a80e774-8ce3-4bbc-a0d3-1df2ea1a5dbd tempest-VolumesNegativeTest-934035935 tempest-VolumesNegativeTest-934035935-project] Returning 404 to user: Volume tempest-invalid-341190051 could not be found. {{(pid=118303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:13:03.048792 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-3a80e774-8ce3-4bbc-a0d3-1df2ea1a5dbd tempest-VolumesNegativeTest-934035935 tempest-VolumesNegativeTest-934035935-project] 10.222.0.77 "DELETE /compute/v2.1/os-volumes/tempest-invalid-341190051" status: 404 len: 98 microversion: 2.1 time: 0.080136 Aug 03 19:13:03.048792 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 336/668] 10.222.0.77 () {58 vars in 1215 bytes} [Wed Aug 3 19:13:02 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-341190051 => generated 98 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 19:13:03.060865 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-d793eb5c-bf15-4b35-bf60-345145e84245 tempest-VolumesNegativeTest-934035935 tempest-VolumesNegativeTest-934035935-project] 10.222.0.77 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003742 Aug 03 19:13:03.062102 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 337/669] 10.222.0.77 () {58 vars in 1140 bytes} [Wed Aug 3 19:13:03 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 03 19:13:03.072224 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-d31495a5-d220-4eb0-84c4-7b00ebec57f1 tempest-VolumesNegativeTest-934035935 tempest-VolumesNegativeTest-934035935-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003823 Aug 03 19:13:03.073103 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 338/670] 10.222.0.77 () {58 vars in 1137 bytes} [Wed Aug 3 19:13:03 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 03 19:13:03.097666 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-7d183521-2dcc-49f6-a9c8-1c63639d56bc tempest-VolumesNegativeTest-934035935 tempest-VolumesNegativeTest-934035935-project] Calling method '.version_select at 0x7f47862794c0>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:03.101032 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-8cb1b4ba-4a95-4bcc-b2b3-7292fdf7cf65 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:03.111506 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-8cb1b4ba-4a95-4bcc-b2b3-7292fdf7cf65 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:03.113980 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-8cb1b4ba-4a95-4bcc-b2b3-7292fdf7cf65 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:03.115912 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-8cb1b4ba-4a95-4bcc-b2b3-7292fdf7cf65 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1737 microversion: 2.20 time: 0.393260 Aug 03 19:13:03.116916 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 333/671] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:02 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1737 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 19:13:03.118030 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.wsgi [None req-7d183521-2dcc-49f6-a9c8-1c63639d56bc tempest-VolumesNegativeTest-934035935 tempest-VolumesNegativeTest-934035935-project] HTTP exception thrown: Volume 76c18917-a17a-48cc-bc4d-5ca8484fe4be could not be found. Aug 03 19:13:03.119989 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-7d183521-2dcc-49f6-a9c8-1c63639d56bc tempest-VolumesNegativeTest-934035935 tempest-VolumesNegativeTest-934035935-project] Request method failure captured: Aug 03 19:13:03.119989 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: request: DELETE /compute/v2.1/os-volumes/76c18917-a17a-48cc-bc4d-5ca8484fe4be HTTP/1.1 Aug 03 19:13:03.119989 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept: application/json Aug 03 19:13:03.119989 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept-Encoding: identity Aug 03 19:13:03.119989 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Connection: close Aug 03 19:13:03.119989 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Length: 0 Aug 03 19:13:03.119989 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Type: application/json Aug 03 19:13:03.119989 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Host: 10.222.0.77 Aug 03 19:13:03.119989 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Openstack-System-Scope: None Aug 03 19:13:03.119989 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: User-Agent: python-urllib3/1.26.11 Aug 03 19:13:03.119989 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Auth-Token: gAAAAABi6si-vtbsffz456685iS9F7atL4o26BsY7gwAxt4hor58-VE0DjD611swd_eGrG1Eg6PC33nfSqd3-IF6WJw4Pvqyw2SWLZnHRM2chJmSn7fKMt08xCeTKCdgKtaG_is_P6GEelROZb5C4vTWjjx4CL1ChnggazCwKbYDiRuqh5IkYts Aug 03 19:13:03.119989 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Id: None Aug 03 19:13:03.119989 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Name: None Aug 03 19:13:03.119989 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Identity-Status: Confirmed Aug 03 19:13:03.119989 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Is-Admin-Project: True Aug 03 19:13:03.119989 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Id: default Aug 03 19:13:03.119989 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Name: Default Aug 03 19:13:03.119989 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Id: 206c32af26d44059948b7e22fd2a1260 Aug 03 19:13:03.119989 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Name: tempest-VolumesNegativeTest-934035935 Aug 03 19:13:03.119989 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Role: reader,member Aug 03 19:13:03.119989 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Roles: reader,member Aug 03 19:13:03.121634 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_206c32af26d44059948b7e22fd2a1260", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/206c32af26d44059948b7e22fd2a1260"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/206c32af26d44059948b7e22fd2a1260"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/206c32af26d44059948b7e22fd2a1260"}]}] Aug 03 19:13:03.121634 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant: tempest-VolumesNegativeTest-934035935 Aug 03 19:13:03.121634 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Id: 206c32af26d44059948b7e22fd2a1260 Aug 03 19:13:03.121634 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Name: tempest-VolumesNegativeTest-934035935 Aug 03 19:13:03.121634 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User: tempest-VolumesNegativeTest-934035935-project Aug 03 19:13:03.121634 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Id: default Aug 03 19:13:03.121634 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Name: Default Aug 03 19:13:03.121634 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Id: 363e70c4be784f52a278c9485657bc20 Aug 03 19:13:03.121634 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Name: tempest-VolumesNegativeTest-934035935-project Aug 03 19:13:03.121634 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: method: Aug 03 19:13:03.121634 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: exception: Volume 76c18917-a17a-48cc-bc4d-5ca8484fe4be could not be found. Aug 03 19:13:03.121634 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: action_args: {'id': '76c18917-a17a-48cc-bc4d-5ca8484fe4be'} Aug 03 19:13:03.121634 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:13:03.122494 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:13:03.122494 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 19:13:03.122494 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 19:13:03.122494 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 19:13:03.122494 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 19:13:03.122494 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 19:13:03.122494 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 19:13:03.122494 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 19:13:03.122494 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 19:13:03.122494 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 19:13:03.122494 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 19:13:03.122494 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 19:13:03.122494 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 19:13:03.122494 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 19:13:03.122494 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 19:13:03.122494 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 76c18917-a17a-48cc-bc4d-5ca8484fe4be could not be found. (HTTP 404) (Request-ID: req-8ff26d51-8263-435a-9868-3ded2e2e2316) Aug 03 19:13:03.122494 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:13:03.122494 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:13:03.122494 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:13:03.126134 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:13:03.126134 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 03 19:13:03.126134 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 03 19:13:03.126134 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 19:13:03.126134 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 19:13:03.126134 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 19:13:03.126134 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 19:13:03.126134 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 19:13:03.126134 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 19:13:03.126134 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 19:13:03.126134 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 19:13:03.126134 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 19:13:03.126134 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 19:13:03.126134 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 19:13:03.126134 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 19:13:03.126134 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 19:13:03.126134 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 19:13:03.126134 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 19:13:03.126134 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 19:13:03.127375 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 19:13:03.127375 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 19:13:03.127375 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 19:13:03.127375 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 19:13:03.127375 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 76c18917-a17a-48cc-bc4d-5ca8484fe4be could not be found. Aug 03 19:13:03.127375 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:13:03.127375 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:13:03.127375 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:13:03.127375 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:13:03.127375 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:13:03.127375 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:13:03.127375 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:13:03.127375 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:13:03.127375 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 19:13:03.127375 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 19:13:03.127375 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:13:03.127375 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:13:03.127375 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 03 19:13:03.127375 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:13:03.129275 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 76c18917-a17a-48cc-bc4d-5ca8484fe4be could not be found. Aug 03 19:13:03.129275 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:13:03.129275 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:13:03.129275 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:13:03.129275 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:13:03.129275 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:13:03.129275 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:13:03.129275 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:13:03.129275 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:13:03.129275 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 76c18917-a17a-48cc-bc4d-5ca8484fe4be could not be found. Aug 03 19:13:03.129275 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:13:03.129275 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-7d183521-2dcc-49f6-a9c8-1c63639d56bc tempest-VolumesNegativeTest-934035935 tempest-VolumesNegativeTest-934035935-project] Returning 404 to user: Volume 76c18917-a17a-48cc-bc4d-5ca8484fe4be could not be found. {{(pid=118303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:13:03.129275 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-7d183521-2dcc-49f6-a9c8-1c63639d56bc tempest-VolumesNegativeTest-934035935 tempest-VolumesNegativeTest-934035935-project] 10.222.0.77 "DELETE /compute/v2.1/os-volumes/76c18917-a17a-48cc-bc4d-5ca8484fe4be" status: 404 len: 109 microversion: 2.1 time: 0.042644 Aug 03 19:13:03.129275 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 339/672] 10.222.0.77 () {58 vars in 1248 bytes} [Wed Aug 3 19:13:03 2022] DELETE /compute/v2.1/os-volumes/76c18917-a17a-48cc-bc4d-5ca8484fe4be => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 19:13:03.140122 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-d8dce9b6-3f13-4083-a02a-0f47ac575371 tempest-VolumesNegativeTest-934035935 tempest-VolumesNegativeTest-934035935-project] Calling method '.version_select at 0x7f478625ea60>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:03.169970 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.wsgi [None req-d8dce9b6-3f13-4083-a02a-0f47ac575371 tempest-VolumesNegativeTest-934035935 tempest-VolumesNegativeTest-934035935-project] HTTP exception thrown: Volume 5257a335-8941-4c93-8c4d-a6c53f2f2b91 could not be found. Aug 03 19:13:03.172160 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-d8dce9b6-3f13-4083-a02a-0f47ac575371 tempest-VolumesNegativeTest-934035935 tempest-VolumesNegativeTest-934035935-project] Request method failure captured: Aug 03 19:13:03.172160 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: request: GET /compute/v2.1/os-volumes/5257a335-8941-4c93-8c4d-a6c53f2f2b91 HTTP/1.1 Aug 03 19:13:03.172160 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept: application/json Aug 03 19:13:03.172160 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept-Encoding: identity Aug 03 19:13:03.172160 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Connection: close Aug 03 19:13:03.172160 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Length: 0 Aug 03 19:13:03.172160 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Type: application/json Aug 03 19:13:03.172160 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Host: 10.222.0.77 Aug 03 19:13:03.172160 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Openstack-System-Scope: None Aug 03 19:13:03.172160 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: User-Agent: python-urllib3/1.26.11 Aug 03 19:13:03.172160 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Auth-Token: gAAAAABi6si-vtbsffz456685iS9F7atL4o26BsY7gwAxt4hor58-VE0DjD611swd_eGrG1Eg6PC33nfSqd3-IF6WJw4Pvqyw2SWLZnHRM2chJmSn7fKMt08xCeTKCdgKtaG_is_P6GEelROZb5C4vTWjjx4CL1ChnggazCwKbYDiRuqh5IkYts Aug 03 19:13:03.172160 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Id: None Aug 03 19:13:03.172160 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Name: None Aug 03 19:13:03.172160 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Identity-Status: Confirmed Aug 03 19:13:03.172160 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Is-Admin-Project: True Aug 03 19:13:03.172160 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Id: default Aug 03 19:13:03.172160 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Name: Default Aug 03 19:13:03.172160 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Id: 206c32af26d44059948b7e22fd2a1260 Aug 03 19:13:03.172160 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Name: tempest-VolumesNegativeTest-934035935 Aug 03 19:13:03.172160 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Role: reader,member Aug 03 19:13:03.172160 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Roles: reader,member Aug 03 19:13:03.173489 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_206c32af26d44059948b7e22fd2a1260", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/206c32af26d44059948b7e22fd2a1260"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/206c32af26d44059948b7e22fd2a1260"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/206c32af26d44059948b7e22fd2a1260"}]}] Aug 03 19:13:03.173489 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant: tempest-VolumesNegativeTest-934035935 Aug 03 19:13:03.173489 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Id: 206c32af26d44059948b7e22fd2a1260 Aug 03 19:13:03.173489 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Name: tempest-VolumesNegativeTest-934035935 Aug 03 19:13:03.173489 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User: tempest-VolumesNegativeTest-934035935-project Aug 03 19:13:03.173489 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Id: default Aug 03 19:13:03.173489 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Name: Default Aug 03 19:13:03.173489 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Id: 363e70c4be784f52a278c9485657bc20 Aug 03 19:13:03.173489 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Name: tempest-VolumesNegativeTest-934035935-project Aug 03 19:13:03.173489 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: method: Aug 03 19:13:03.173489 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: exception: Volume 5257a335-8941-4c93-8c4d-a6c53f2f2b91 could not be found. Aug 03 19:13:03.173489 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: action_args: {'id': '5257a335-8941-4c93-8c4d-a6c53f2f2b91'} Aug 03 19:13:03.173489 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:13:03.194743 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:13:03.194743 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 19:13:03.194743 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 19:13:03.194743 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 19:13:03.194743 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 19:13:03.194743 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 19:13:03.194743 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 19:13:03.194743 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 19:13:03.194743 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 19:13:03.194743 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 19:13:03.194743 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 19:13:03.194743 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 19:13:03.194743 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 19:13:03.194743 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 19:13:03.194743 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 19:13:03.194743 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5257a335-8941-4c93-8c4d-a6c53f2f2b91 could not be found. (HTTP 404) (Request-ID: req-727f883f-3591-4d2d-ab91-624dbb220fe1) Aug 03 19:13:03.194743 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:13:03.194743 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:13:03.194743 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:13:03.196240 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:13:03.196240 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 03 19:13:03.196240 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 03 19:13:03.196240 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 19:13:03.196240 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 19:13:03.196240 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 19:13:03.196240 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 19:13:03.196240 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 19:13:03.196240 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 19:13:03.196240 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 19:13:03.196240 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 19:13:03.196240 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 19:13:03.196240 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 19:13:03.196240 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 19:13:03.196240 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 19:13:03.196240 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 19:13:03.196240 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 19:13:03.196240 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 19:13:03.196240 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 19:13:03.197405 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 19:13:03.197405 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 19:13:03.197405 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 19:13:03.197405 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 19:13:03.197405 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5257a335-8941-4c93-8c4d-a6c53f2f2b91 could not be found. Aug 03 19:13:03.197405 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:13:03.197405 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:13:03.197405 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:13:03.197405 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:13:03.197405 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:13:03.197405 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:13:03.197405 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:13:03.197405 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:13:03.197405 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 19:13:03.197405 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 19:13:03.197405 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:13:03.197405 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:13:03.197405 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 03 19:13:03.197405 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:13:03.199403 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5257a335-8941-4c93-8c4d-a6c53f2f2b91 could not be found. Aug 03 19:13:03.199403 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:13:03.199403 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:13:03.199403 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:13:03.199403 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:13:03.199403 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:13:03.199403 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:13:03.199403 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:13:03.199403 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:13:03.199403 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5257a335-8941-4c93-8c4d-a6c53f2f2b91 could not be found. Aug 03 19:13:03.199403 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:13:03.199403 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-d8dce9b6-3f13-4083-a02a-0f47ac575371 tempest-VolumesNegativeTest-934035935 tempest-VolumesNegativeTest-934035935-project] Returning 404 to user: Volume 5257a335-8941-4c93-8c4d-a6c53f2f2b91 could not be found. {{(pid=118302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:13:03.199403 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-d8dce9b6-3f13-4083-a02a-0f47ac575371 tempest-VolumesNegativeTest-934035935 tempest-VolumesNegativeTest-934035935-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/5257a335-8941-4c93-8c4d-a6c53f2f2b91" status: 404 len: 109 microversion: 2.1 time: 0.044582 Aug 03 19:13:03.199403 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 334/673] 10.222.0.77 () {58 vars in 1245 bytes} [Wed Aug 3 19:13:03 2022] GET /compute/v2.1/os-volumes/5257a335-8941-4c93-8c4d-a6c53f2f2b91 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:13:04.153427 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-cd1ad91c-cd7f-444c-ae96-9eb6cdc85980 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:04.154817 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-cd1ad91c-cd7f-444c-ae96-9eb6cdc85980 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:04.166017 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:13:04.168658 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cd1ad91c-cd7f-444c-ae96-9eb6cdc85980 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:04.171554 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cd1ad91c-cd7f-444c-ae96-9eb6cdc85980 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:04.172596 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cd1ad91c-cd7f-444c-ae96-9eb6cdc85980 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:04.173211 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cd1ad91c-cd7f-444c-ae96-9eb6cdc85980 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:04.430749 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-cd1ad91c-cd7f-444c-ae96-9eb6cdc85980 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:04.440681 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-cd1ad91c-cd7f-444c-ae96-9eb6cdc85980 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:04.443556 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-cd1ad91c-cd7f-444c-ae96-9eb6cdc85980 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:04.445192 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-cd1ad91c-cd7f-444c-ae96-9eb6cdc85980 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1737 microversion: 2.20 time: 0.296948 Aug 03 19:13:04.460152 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 340/674] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:04 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1737 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:13:05.474424 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-8f70f5a0-9b8d-4664-8d6e-c62523071707 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:05.476123 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-8f70f5a0-9b8d-4664-8d6e-c62523071707 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:05.483681 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8f70f5a0-9b8d-4664-8d6e-c62523071707 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:05.484511 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8f70f5a0-9b8d-4664-8d6e-c62523071707 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:05.485295 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8f70f5a0-9b8d-4664-8d6e-c62523071707 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:05.485773 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8f70f5a0-9b8d-4664-8d6e-c62523071707 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:05.703287 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-8f70f5a0-9b8d-4664-8d6e-c62523071707 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:05.712711 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-8f70f5a0-9b8d-4664-8d6e-c62523071707 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:05.714130 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-8f70f5a0-9b8d-4664-8d6e-c62523071707 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:05.715443 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-8f70f5a0-9b8d-4664-8d6e-c62523071707 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1737 microversion: 2.20 time: 0.248583 Aug 03 19:13:05.727432 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 335/675] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:05 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1737 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:13:06.742430 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-bf9b6564-c8f8-4d7e-9b6e-841b1dace5dc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:06.743838 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-bf9b6564-c8f8-4d7e-9b6e-841b1dace5dc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:06.751299 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-bf9b6564-c8f8-4d7e-9b6e-841b1dace5dc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:06.754136 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-bf9b6564-c8f8-4d7e-9b6e-841b1dace5dc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:06.758525 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-bf9b6564-c8f8-4d7e-9b6e-841b1dace5dc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:06.763169 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-bf9b6564-c8f8-4d7e-9b6e-841b1dace5dc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:06.956075 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-bf9b6564-c8f8-4d7e-9b6e-841b1dace5dc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:06.967720 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-bf9b6564-c8f8-4d7e-9b6e-841b1dace5dc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:06.969269 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-bf9b6564-c8f8-4d7e-9b6e-841b1dace5dc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:06.970741 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-bf9b6564-c8f8-4d7e-9b6e-841b1dace5dc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1737 microversion: 2.20 time: 0.232845 Aug 03 19:13:06.971789 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 341/676] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:06 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1737 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:13:07.995937 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-5d3619f2-c154-494f-81f2-766a13028b2a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:07.997517 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-5d3619f2-c154-494f-81f2-766a13028b2a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:08.007201 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-5d3619f2-c154-494f-81f2-766a13028b2a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:08.008466 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-5d3619f2-c154-494f-81f2-766a13028b2a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:08.009819 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-5d3619f2-c154-494f-81f2-766a13028b2a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:08.010432 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-5d3619f2-c154-494f-81f2-766a13028b2a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:08.189131 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-5d3619f2-c154-494f-81f2-766a13028b2a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:08.199452 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-5d3619f2-c154-494f-81f2-766a13028b2a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:08.203234 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-5d3619f2-c154-494f-81f2-766a13028b2a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:08.203234 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-5d3619f2-c154-494f-81f2-766a13028b2a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1737 microversion: 2.20 time: 0.212475 Aug 03 19:13:08.203996 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 336/677] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:07 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 19:13:09.234571 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-b94a013f-97f3-48d9-afe4-334607d34161 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:09.234571 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-b94a013f-97f3-48d9-afe4-334607d34161 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:09.235429 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b94a013f-97f3-48d9-afe4-334607d34161 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:09.236107 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b94a013f-97f3-48d9-afe4-334607d34161 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:09.236894 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b94a013f-97f3-48d9-afe4-334607d34161 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:09.237602 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b94a013f-97f3-48d9-afe4-334607d34161 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:09.402176 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-b94a013f-97f3-48d9-afe4-334607d34161 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:09.414642 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-b94a013f-97f3-48d9-afe4-334607d34161 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:09.416661 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-b94a013f-97f3-48d9-afe4-334607d34161 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:09.418660 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-b94a013f-97f3-48d9-afe4-334607d34161 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1737 microversion: 2.20 time: 0.194183 Aug 03 19:13:09.420724 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 342/678] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:09 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1737 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:13:10.299731 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 19:13:10.300700 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Wed Aug 3 19:13:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 19:13:10.449313 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-d3904632-5f54-4086-b455-8bf0be27d3b3 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:10.450675 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-d3904632-5f54-4086-b455-8bf0be27d3b3 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:10.460803 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d3904632-5f54-4086-b455-8bf0be27d3b3 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:10.463184 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d3904632-5f54-4086-b455-8bf0be27d3b3 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:10.463184 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d3904632-5f54-4086-b455-8bf0be27d3b3 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:10.463735 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d3904632-5f54-4086-b455-8bf0be27d3b3 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:10.647783 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-d3904632-5f54-4086-b455-8bf0be27d3b3 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:10.668722 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-d3904632-5f54-4086-b455-8bf0be27d3b3 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:10.672302 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-d3904632-5f54-4086-b455-8bf0be27d3b3 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:10.673727 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-d3904632-5f54-4086-b455-8bf0be27d3b3 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1737 microversion: 2.20 time: 0.229504 Aug 03 19:13:10.692256 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 337/679] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:10 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1737 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:13:11.702304 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-5c59416c-1d2a-4138-a321-5dfe77b9fb11 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:11.702911 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-5c59416c-1d2a-4138-a321-5dfe77b9fb11 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:11.715204 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5c59416c-1d2a-4138-a321-5dfe77b9fb11 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:11.715708 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5c59416c-1d2a-4138-a321-5dfe77b9fb11 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:11.716586 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5c59416c-1d2a-4138-a321-5dfe77b9fb11 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:11.717074 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5c59416c-1d2a-4138-a321-5dfe77b9fb11 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:11.853749 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-5c59416c-1d2a-4138-a321-5dfe77b9fb11 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:11.862792 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-5c59416c-1d2a-4138-a321-5dfe77b9fb11 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:11.864832 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-5c59416c-1d2a-4138-a321-5dfe77b9fb11 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:11.866081 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-5c59416c-1d2a-4138-a321-5dfe77b9fb11 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1737 microversion: 2.20 time: 0.167943 Aug 03 19:13:11.869211 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 343/680] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:11 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:13:12.890467 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-27484702-3a9c-44d6-aa1c-973fccb54559 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:12.891344 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-27484702-3a9c-44d6-aa1c-973fccb54559 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:12.898539 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-27484702-3a9c-44d6-aa1c-973fccb54559 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:12.899245 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-27484702-3a9c-44d6-aa1c-973fccb54559 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:12.899832 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-27484702-3a9c-44d6-aa1c-973fccb54559 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:12.900304 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-27484702-3a9c-44d6-aa1c-973fccb54559 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:13.092445 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-27484702-3a9c-44d6-aa1c-973fccb54559 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:13.101739 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-27484702-3a9c-44d6-aa1c-973fccb54559 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:13.103637 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-27484702-3a9c-44d6-aa1c-973fccb54559 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:13.104802 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-27484702-3a9c-44d6-aa1c-973fccb54559 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1737 microversion: 2.20 time: 0.219029 Aug 03 19:13:13.105360 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 338/681] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:12 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1737 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:13:14.129139 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-bd93cd06-ea0d-46e0-a426-7a3d8cd640bc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:14.129913 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-bd93cd06-ea0d-46e0-a426-7a3d8cd640bc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:14.136784 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-bd93cd06-ea0d-46e0-a426-7a3d8cd640bc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:14.137265 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-bd93cd06-ea0d-46e0-a426-7a3d8cd640bc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:14.138040 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-bd93cd06-ea0d-46e0-a426-7a3d8cd640bc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:14.138552 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-bd93cd06-ea0d-46e0-a426-7a3d8cd640bc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:14.283526 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-bd93cd06-ea0d-46e0-a426-7a3d8cd640bc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:14.295838 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-bd93cd06-ea0d-46e0-a426-7a3d8cd640bc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:14.297451 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-bd93cd06-ea0d-46e0-a426-7a3d8cd640bc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:14.298802 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-bd93cd06-ea0d-46e0-a426-7a3d8cd640bc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1719 microversion: 2.20 time: 0.174508 Aug 03 19:13:14.299970 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 344/682] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:14 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1719 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:13:15.323132 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-4e967e20-be15-48d0-9e49-910f5c5650f0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:15.324367 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-4e967e20-be15-48d0-9e49-910f5c5650f0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:15.331489 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4e967e20-be15-48d0-9e49-910f5c5650f0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:15.332024 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4e967e20-be15-48d0-9e49-910f5c5650f0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:15.332875 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4e967e20-be15-48d0-9e49-910f5c5650f0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:15.333386 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4e967e20-be15-48d0-9e49-910f5c5650f0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:15.466753 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-4e967e20-be15-48d0-9e49-910f5c5650f0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:15.477837 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-4e967e20-be15-48d0-9e49-910f5c5650f0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:15.477837 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-4e967e20-be15-48d0-9e49-910f5c5650f0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:15.478658 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-4e967e20-be15-48d0-9e49-910f5c5650f0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1719 microversion: 2.20 time: 0.160040 Aug 03 19:13:15.479126 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 339/683] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:15 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1719 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:13:16.503511 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-1460a9e1-3c69-42a6-b524-ca657ce3bc3b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:16.504823 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-1460a9e1-3c69-42a6-b524-ca657ce3bc3b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:16.512093 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1460a9e1-3c69-42a6-b524-ca657ce3bc3b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:16.512549 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1460a9e1-3c69-42a6-b524-ca657ce3bc3b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:16.513582 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1460a9e1-3c69-42a6-b524-ca657ce3bc3b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:16.514028 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1460a9e1-3c69-42a6-b524-ca657ce3bc3b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:16.700453 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-1460a9e1-3c69-42a6-b524-ca657ce3bc3b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:16.708832 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-1460a9e1-3c69-42a6-b524-ca657ce3bc3b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:16.710321 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-1460a9e1-3c69-42a6-b524-ca657ce3bc3b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:16.711545 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-1460a9e1-3c69-42a6-b524-ca657ce3bc3b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1719 microversion: 2.20 time: 0.213573 Aug 03 19:13:16.712107 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 345/684] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:16 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1719 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 19:13:17.733751 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-f85e7b4e-6407-4ea5-b297-209edf8c41c9 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:17.734362 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-f85e7b4e-6407-4ea5-b297-209edf8c41c9 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:17.741156 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f85e7b4e-6407-4ea5-b297-209edf8c41c9 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:17.741605 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f85e7b4e-6407-4ea5-b297-209edf8c41c9 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:17.742382 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f85e7b4e-6407-4ea5-b297-209edf8c41c9 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:17.742822 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f85e7b4e-6407-4ea5-b297-209edf8c41c9 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:17.898034 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-f85e7b4e-6407-4ea5-b297-209edf8c41c9 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:17.906065 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-f85e7b4e-6407-4ea5-b297-209edf8c41c9 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:17.907617 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-f85e7b4e-6407-4ea5-b297-209edf8c41c9 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:17.908830 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-f85e7b4e-6407-4ea5-b297-209edf8c41c9 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1662 microversion: 2.20 time: 0.179021 Aug 03 19:13:17.911049 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 340/685] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:17 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1662 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:13:17.932754 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-deac0faf-1a8e-42d1-ae8b-e6eb4885979e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2cd1a5c5-0872-444a-bc60-45b37f67b6da"}} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:13:17.935242 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-deac0faf-1a8e-42d1-ae8b-e6eb4885979e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:17.942318 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-deac0faf-1a8e-42d1-ae8b-e6eb4885979e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:17.943059 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-deac0faf-1a8e-42d1-ae8b-e6eb4885979e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:17.944395 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-deac0faf-1a8e-42d1-ae8b-e6eb4885979e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:17.944827 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-deac0faf-1a8e-42d1-ae8b-e6eb4885979e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:18.025433 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:13:18.153805 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-f538901b-d465-45b6-a35f-cc0110ea363e req-f561ab96-4605-4e4f-861d-d69dfa044b05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e21c8ef-c172-41cd-806e-f69f81116b6a", "name": "network-vif-unplugged", "status": "completed", "tag": "5bac2969-4e88-4008-93e1-3408ccc91cbb"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:13:18.164708 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-f538901b-d465-45b6-a35f-cc0110ea363e req-f561ab96-4605-4e4f-861d-d69dfa044b05 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:18.165156 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-f538901b-d465-45b6-a35f-cc0110ea363e req-f561ab96-4605-4e4f-861d-d69dfa044b05 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:18.177452 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.compute.server_external_events [req-f538901b-d465-45b6-a35f-cc0110ea363e req-f561ab96-4605-4e4f-861d-d69dfa044b05 service nova] Unable to find a host for instance 2e21c8ef-c172-41cd-806e-f69f81116b6a. Dropping event network-vif-unplugged {{(pid=118302) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 03 19:13:18.178433 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-f538901b-d465-45b6-a35f-cc0110ea363e req-f561ab96-4605-4e4f-861d-d69dfa044b05 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028393 Aug 03 19:13:18.179214 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 341/686] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 03 19:13:19.156822 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-deac0faf-1a8e-42d1-ae8b-e6eb4885979e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "POST /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.228090 Aug 03 19:13:19.157476 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 346/687] 10.222.0.77 () {62 vars in 1364 bytes} [Wed Aug 3 19:13:17 2022] POST /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a/os-volume_attachments => generated 188 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 19:13:19.294342 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-dcefa77f-62aa-49bc-8766-d3c36bea9b4e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:13:19.295359 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-dcefa77f-62aa-49bc-8766-d3c36bea9b4e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:19.305491 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-dcefa77f-62aa-49bc-8766-d3c36bea9b4e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:19.305491 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-dcefa77f-62aa-49bc-8766-d3c36bea9b4e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:19.305491 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-dcefa77f-62aa-49bc-8766-d3c36bea9b4e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:19.305491 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-dcefa77f-62aa-49bc-8766-d3c36bea9b4e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:19.335964 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-dcefa77f-62aa-49bc-8766-d3c36bea9b4e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118302) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 03 19:13:19.494926 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:13:19.576463 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-dcefa77f-62aa-49bc-8766-d3c36bea9b4e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "POST /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a/action" status: 202 len: 0 microversion: 2.20 time: 0.286468 Aug 03 19:13:19.577999 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 342/688] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 3 19:13:19 2022] POST /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 19:13:19.586404 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-958859dd-8e8a-4b33-947c-f6f793fc2ead tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:19.587091 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-958859dd-8e8a-4b33-947c-f6f793fc2ead tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:19.594646 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-958859dd-8e8a-4b33-947c-f6f793fc2ead tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:19.597799 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-958859dd-8e8a-4b33-947c-f6f793fc2ead tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:19.597799 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-958859dd-8e8a-4b33-947c-f6f793fc2ead tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:19.597799 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-958859dd-8e8a-4b33-947c-f6f793fc2ead tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:19.746583 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-958859dd-8e8a-4b33-947c-f6f793fc2ead tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:19.763396 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-958859dd-8e8a-4b33-947c-f6f793fc2ead tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:19.765839 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-958859dd-8e8a-4b33-947c-f6f793fc2ead tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:19.767762 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-958859dd-8e8a-4b33-947c-f6f793fc2ead tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1748 microversion: 2.20 time: 0.185225 Aug 03 19:13:19.769363 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 347/689] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:19 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1748 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:13:20.792366 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-a90d43dc-71fd-437f-ad23-d219bbdc0532 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:20.792979 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-a90d43dc-71fd-437f-ad23-d219bbdc0532 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:20.800472 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a90d43dc-71fd-437f-ad23-d219bbdc0532 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:20.800920 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a90d43dc-71fd-437f-ad23-d219bbdc0532 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:20.801687 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a90d43dc-71fd-437f-ad23-d219bbdc0532 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:20.802121 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a90d43dc-71fd-437f-ad23-d219bbdc0532 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:20.941391 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-a90d43dc-71fd-437f-ad23-d219bbdc0532 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:20.951582 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-a90d43dc-71fd-437f-ad23-d219bbdc0532 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:20.953383 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-a90d43dc-71fd-437f-ad23-d219bbdc0532 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:20.954836 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-a90d43dc-71fd-437f-ad23-d219bbdc0532 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1748 microversion: 2.20 time: 0.167180 Aug 03 19:13:20.955715 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 343/690] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:20 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1748 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:13:21.979862 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-756af675-5634-4d65-916d-fd4e37b1da99 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:21.980406 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-756af675-5634-4d65-916d-fd4e37b1da99 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:21.989721 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-756af675-5634-4d65-916d-fd4e37b1da99 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:21.990487 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-756af675-5634-4d65-916d-fd4e37b1da99 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:21.991855 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-756af675-5634-4d65-916d-fd4e37b1da99 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:21.992585 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-756af675-5634-4d65-916d-fd4e37b1da99 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:22.232872 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-756af675-5634-4d65-916d-fd4e37b1da99 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:22.243383 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-756af675-5634-4d65-916d-fd4e37b1da99 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:22.245312 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-756af675-5634-4d65-916d-fd4e37b1da99 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:22.247408 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-756af675-5634-4d65-916d-fd4e37b1da99 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1750 microversion: 2.20 time: 0.271026 Aug 03 19:13:22.248431 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 348/691] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:21 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1750 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 19:13:23.275711 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-7e66f735-9030-4f3e-9717-6251d3566a93 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:23.276273 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-7e66f735-9030-4f3e-9717-6251d3566a93 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:23.286882 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7e66f735-9030-4f3e-9717-6251d3566a93 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:23.287561 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7e66f735-9030-4f3e-9717-6251d3566a93 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:23.288672 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7e66f735-9030-4f3e-9717-6251d3566a93 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:23.289101 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7e66f735-9030-4f3e-9717-6251d3566a93 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:23.465849 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-7e66f735-9030-4f3e-9717-6251d3566a93 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:23.475475 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-7e66f735-9030-4f3e-9717-6251d3566a93 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:23.477579 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-7e66f735-9030-4f3e-9717-6251d3566a93 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:23.482663 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-7e66f735-9030-4f3e-9717-6251d3566a93 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1806 microversion: 2.20 time: 0.207927 Aug 03 19:13:23.482663 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 344/692] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:23 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1806 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:13:24.502237 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-74f8937e-72d0-4c5b-a273-c0042e3ae19d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:24.503367 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-74f8937e-72d0-4c5b-a273-c0042e3ae19d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:24.511261 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-74f8937e-72d0-4c5b-a273-c0042e3ae19d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:24.513297 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-74f8937e-72d0-4c5b-a273-c0042e3ae19d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:24.513297 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-74f8937e-72d0-4c5b-a273-c0042e3ae19d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:24.513733 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-74f8937e-72d0-4c5b-a273-c0042e3ae19d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:24.711289 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-74f8937e-72d0-4c5b-a273-c0042e3ae19d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:24.725643 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-74f8937e-72d0-4c5b-a273-c0042e3ae19d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:24.728049 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-74f8937e-72d0-4c5b-a273-c0042e3ae19d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:24.729538 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-74f8937e-72d0-4c5b-a273-c0042e3ae19d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1806 microversion: 2.20 time: 0.231451 Aug 03 19:13:24.746262 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 349/693] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:24 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1806 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:13:25.754782 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-8589f6ea-0870-47d1-a858-bfd6b0cfca7c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:25.756071 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-8589f6ea-0870-47d1-a858-bfd6b0cfca7c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:25.761946 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:13:25.764162 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8589f6ea-0870-47d1-a858-bfd6b0cfca7c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:25.764619 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8589f6ea-0870-47d1-a858-bfd6b0cfca7c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:25.765402 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8589f6ea-0870-47d1-a858-bfd6b0cfca7c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:25.765870 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8589f6ea-0870-47d1-a858-bfd6b0cfca7c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:25.951486 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-8589f6ea-0870-47d1-a858-bfd6b0cfca7c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:25.960721 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-8589f6ea-0870-47d1-a858-bfd6b0cfca7c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:25.962499 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-8589f6ea-0870-47d1-a858-bfd6b0cfca7c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:25.964062 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-8589f6ea-0870-47d1-a858-bfd6b0cfca7c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1806 microversion: 2.20 time: 0.213984 Aug 03 19:13:25.965059 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 345/694] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:25 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1806 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:13:26.989635 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-f9c1d870-a52d-4478-83d8-0de3a38b6ecc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:26.990266 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-f9c1d870-a52d-4478-83d8-0de3a38b6ecc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:26.998535 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f9c1d870-a52d-4478-83d8-0de3a38b6ecc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:26.999446 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f9c1d870-a52d-4478-83d8-0de3a38b6ecc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:27.010316 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f9c1d870-a52d-4478-83d8-0de3a38b6ecc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:27.010316 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f9c1d870-a52d-4478-83d8-0de3a38b6ecc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:27.203350 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-f9c1d870-a52d-4478-83d8-0de3a38b6ecc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:27.213187 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-f9c1d870-a52d-4478-83d8-0de3a38b6ecc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:27.214817 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-f9c1d870-a52d-4478-83d8-0de3a38b6ecc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:27.216161 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-f9c1d870-a52d-4478-83d8-0de3a38b6ecc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1806 microversion: 2.20 time: 0.231495 Aug 03 19:13:27.216862 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 350/695] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:26 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1806 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:13:28.240755 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-bad8a121-98ca-4adf-b9a3-70874f39a98f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:28.241391 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-bad8a121-98ca-4adf-b9a3-70874f39a98f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:28.255567 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-bad8a121-98ca-4adf-b9a3-70874f39a98f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:28.256017 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-bad8a121-98ca-4adf-b9a3-70874f39a98f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:28.256801 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-bad8a121-98ca-4adf-b9a3-70874f39a98f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:28.257265 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-bad8a121-98ca-4adf-b9a3-70874f39a98f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:28.398457 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-bad8a121-98ca-4adf-b9a3-70874f39a98f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:28.407095 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-bad8a121-98ca-4adf-b9a3-70874f39a98f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:28.408578 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-bad8a121-98ca-4adf-b9a3-70874f39a98f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:28.409722 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-bad8a121-98ca-4adf-b9a3-70874f39a98f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1806 microversion: 2.20 time: 0.173816 Aug 03 19:13:28.411494 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 346/696] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:28 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1806 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:13:29.435034 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-bcaf365e-9660-4ffe-afd9-6ed3cc4862bd tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:29.437309 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-bcaf365e-9660-4ffe-afd9-6ed3cc4862bd tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:29.446783 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-bcaf365e-9660-4ffe-afd9-6ed3cc4862bd tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:29.452008 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-bcaf365e-9660-4ffe-afd9-6ed3cc4862bd tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:29.452008 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-bcaf365e-9660-4ffe-afd9-6ed3cc4862bd tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:29.452008 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-bcaf365e-9660-4ffe-afd9-6ed3cc4862bd tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:29.590108 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-bcaf365e-9660-4ffe-afd9-6ed3cc4862bd tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:29.599572 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-bcaf365e-9660-4ffe-afd9-6ed3cc4862bd tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:29.601317 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-bcaf365e-9660-4ffe-afd9-6ed3cc4862bd tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:29.602489 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-bcaf365e-9660-4ffe-afd9-6ed3cc4862bd tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1806 microversion: 2.20 time: 0.172649 Aug 03 19:13:29.603101 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 351/697] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:29 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 19:13:30.627605 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-5110a6bc-043d-4fc7-adfa-bb2d70f15ab8 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:30.627605 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-5110a6bc-043d-4fc7-adfa-bb2d70f15ab8 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:30.633005 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-5110a6bc-043d-4fc7-adfa-bb2d70f15ab8 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:30.633461 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-5110a6bc-043d-4fc7-adfa-bb2d70f15ab8 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:30.634222 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-5110a6bc-043d-4fc7-adfa-bb2d70f15ab8 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:30.634704 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-5110a6bc-043d-4fc7-adfa-bb2d70f15ab8 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:30.765242 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-5110a6bc-043d-4fc7-adfa-bb2d70f15ab8 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:30.774437 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-5110a6bc-043d-4fc7-adfa-bb2d70f15ab8 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:30.776177 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-5110a6bc-043d-4fc7-adfa-bb2d70f15ab8 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:30.777342 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-5110a6bc-043d-4fc7-adfa-bb2d70f15ab8 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1806 microversion: 2.20 time: 0.155596 Aug 03 19:13:30.777938 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 347/698] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:30 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:13:31.802021 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-ff1e84fb-9b17-4b82-809b-7adfccd07d31 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:31.802802 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-ff1e84fb-9b17-4b82-809b-7adfccd07d31 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:31.809538 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ff1e84fb-9b17-4b82-809b-7adfccd07d31 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:31.810240 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ff1e84fb-9b17-4b82-809b-7adfccd07d31 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:31.811209 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ff1e84fb-9b17-4b82-809b-7adfccd07d31 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:31.811791 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ff1e84fb-9b17-4b82-809b-7adfccd07d31 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:31.966767 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-ff1e84fb-9b17-4b82-809b-7adfccd07d31 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:31.978323 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-ff1e84fb-9b17-4b82-809b-7adfccd07d31 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:31.980181 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-ff1e84fb-9b17-4b82-809b-7adfccd07d31 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:31.981549 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-ff1e84fb-9b17-4b82-809b-7adfccd07d31 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1806 microversion: 2.20 time: 0.184039 Aug 03 19:13:31.995597 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 352/699] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:31 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1806 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:13:33.006339 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-41c936e0-2aea-48aa-9c54-c8cdf280bcd7 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:33.011529 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-41c936e0-2aea-48aa-9c54-c8cdf280bcd7 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:33.013822 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-41c936e0-2aea-48aa-9c54-c8cdf280bcd7 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:33.014283 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-41c936e0-2aea-48aa-9c54-c8cdf280bcd7 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:33.015089 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-41c936e0-2aea-48aa-9c54-c8cdf280bcd7 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:33.015531 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-41c936e0-2aea-48aa-9c54-c8cdf280bcd7 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:33.189786 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-41c936e0-2aea-48aa-9c54-c8cdf280bcd7 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:33.201852 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-41c936e0-2aea-48aa-9c54-c8cdf280bcd7 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:33.203407 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-41c936e0-2aea-48aa-9c54-c8cdf280bcd7 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:33.204609 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-41c936e0-2aea-48aa-9c54-c8cdf280bcd7 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1806 microversion: 2.20 time: 0.202231 Aug 03 19:13:33.205164 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 348/700] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:33 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1806 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 19:13:34.231699 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-797df7e1-7aab-4fba-9161-262918563e85 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:34.232939 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-797df7e1-7aab-4fba-9161-262918563e85 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:34.241502 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-797df7e1-7aab-4fba-9161-262918563e85 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:34.244323 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-797df7e1-7aab-4fba-9161-262918563e85 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:34.245147 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-797df7e1-7aab-4fba-9161-262918563e85 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:34.245599 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-797df7e1-7aab-4fba-9161-262918563e85 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:34.663896 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-797df7e1-7aab-4fba-9161-262918563e85 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:34.672751 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-797df7e1-7aab-4fba-9161-262918563e85 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:34.674245 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-797df7e1-7aab-4fba-9161-262918563e85 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:34.675421 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-797df7e1-7aab-4fba-9161-262918563e85 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1806 microversion: 2.20 time: 0.449801 Aug 03 19:13:34.676366 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 353/701] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:34 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1806 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:13:35.698860 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-32cfdcc1-3b36-48e9-8965-83f9e975eb64 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:35.699588 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-32cfdcc1-3b36-48e9-8965-83f9e975eb64 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:35.706070 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-32cfdcc1-3b36-48e9-8965-83f9e975eb64 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:35.706513 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-32cfdcc1-3b36-48e9-8965-83f9e975eb64 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:35.708226 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-32cfdcc1-3b36-48e9-8965-83f9e975eb64 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:35.708723 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-32cfdcc1-3b36-48e9-8965-83f9e975eb64 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:35.848417 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-32cfdcc1-3b36-48e9-8965-83f9e975eb64 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:35.857307 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-32cfdcc1-3b36-48e9-8965-83f9e975eb64 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:35.858796 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-32cfdcc1-3b36-48e9-8965-83f9e975eb64 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:35.860012 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-32cfdcc1-3b36-48e9-8965-83f9e975eb64 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1806 microversion: 2.20 time: 0.165031 Aug 03 19:13:35.860564 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 349/702] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:35 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1806 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:13:36.883016 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-8312c5b9-7d58-4a37-ae94-62e769e9b4d6 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:36.883710 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-8312c5b9-7d58-4a37-ae94-62e769e9b4d6 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:36.887218 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_api:SELECT=28 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:13:36.890910 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8312c5b9-7d58-4a37-ae94-62e769e9b4d6 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:36.891454 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8312c5b9-7d58-4a37-ae94-62e769e9b4d6 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:36.892171 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8312c5b9-7d58-4a37-ae94-62e769e9b4d6 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:36.892608 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8312c5b9-7d58-4a37-ae94-62e769e9b4d6 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:37.024695 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-8312c5b9-7d58-4a37-ae94-62e769e9b4d6 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:37.033463 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-8312c5b9-7d58-4a37-ae94-62e769e9b4d6 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:37.035715 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-8312c5b9-7d58-4a37-ae94-62e769e9b4d6 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:37.036976 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-8312c5b9-7d58-4a37-ae94-62e769e9b4d6 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1806 microversion: 2.20 time: 0.158120 Aug 03 19:13:37.037529 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 354/703] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:36 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:13:38.060494 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-fb3b5f44-10b3-48ad-a72b-01e72dbb6352 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:38.061055 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-fb3b5f44-10b3-48ad-a72b-01e72dbb6352 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:38.067721 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fb3b5f44-10b3-48ad-a72b-01e72dbb6352 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:38.068163 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fb3b5f44-10b3-48ad-a72b-01e72dbb6352 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:38.069854 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fb3b5f44-10b3-48ad-a72b-01e72dbb6352 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:38.069854 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fb3b5f44-10b3-48ad-a72b-01e72dbb6352 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:38.072543 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-1d234a85-4935-47a2-bf40-c511769eb76c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1582405218", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1132387639", "security_groups": [{"name": "tempest-secgroup-smoke-499638857"}], "block_device_mapping_v2": [{"uuid": "4a00e4e8-39ae-43b7-9292-60405fd10217", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9ccc48a3-6dd8-4736-87f7-cf1e5f400519"}]}} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:13:38.230464 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.network.neutron [None req-1d234a85-4935-47a2-bf40-c511769eb76c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] validate_networks() for [('9ccc48a3-6dd8-4736-87f7-cf1e5f400519', None, None, None, None, None)] {{(pid=118303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 19:13:38.256674 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-fb3b5f44-10b3-48ad-a72b-01e72dbb6352 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:38.266467 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-fb3b5f44-10b3-48ad-a72b-01e72dbb6352 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:38.268185 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-fb3b5f44-10b3-48ad-a72b-01e72dbb6352 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:38.269374 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-fb3b5f44-10b3-48ad-a72b-01e72dbb6352 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1806 microversion: 2.20 time: 0.213062 Aug 03 19:13:38.269936 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 350/704] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:38 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1806 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:13:38.640344 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-1d234a85-4935-47a2-bf40-c511769eb76c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Flavor limits 0:0:0 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 19:13:38.640773 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-1d234a85-4935-47a2-bf40-c511769eb76c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Image limits 0:0:0 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 19:13:38.641249 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-1d234a85-4935-47a2-bf40-c511769eb76c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Flavor pref 0:0:0 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 19:13:38.641660 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-1d234a85-4935-47a2-bf40-c511769eb76c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Image pref 0:0:0 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 19:13:38.642081 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-1d234a85-4935-47a2-bf40-c511769eb76c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 19:13:38.651988 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1d234a85-4935-47a2-bf40-c511769eb76c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:38.652435 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1d234a85-4935-47a2-bf40-c511769eb76c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:38.653238 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1d234a85-4935-47a2-bf40-c511769eb76c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:38.653733 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1d234a85-4935-47a2-bf40-c511769eb76c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:38.672605 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.quota [None req-1d234a85-4935-47a2-bf40-c511769eb76c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Getting quotas for project 28d15350ea8f45b490bb080384999f4b. Resources: {'instances', 'cores', 'ram'} {{(pid=118303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:13:38.677012 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.quota [None req-1d234a85-4935-47a2-bf40-c511769eb76c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Getting quotas for user 626fe64980ed40d4bbb829c75dc0067c and project 28d15350ea8f45b490bb080384999f4b. Resources: {'instances', 'cores', 'ram'} {{(pid=118303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:13:38.738656 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-1d234a85-4935-47a2-bf40-c511769eb76c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Going to run 1 instances... {{(pid=118303) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 19:13:38.741274 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-1d234a85-4935-47a2-bf40-c511769eb76c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c125b049-e40d-48d8-99a0-e3113210600c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4a00e4e8-39ae-43b7-9292-60405fd10217',volume_size=None,volume_type=None)] {{(pid=118303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 19:13:39.264815 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-1d234a85-4935-47a2-bf40-c511769eb76c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.197469 Aug 03 19:13:39.266242 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 355/705] 10.222.0.77 () {60 vars in 1147 bytes} [Wed Aug 3 19:13:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 1199 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 19:13:39.276341 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-0113fe49-be47-4749-afc7-e2c1d3b02519 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:39.277142 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-0113fe49-be47-4749-afc7-e2c1d3b02519 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c125b049-e40d-48d8-99a0-e3113210600c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:39.293429 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-2c809aed-6f6c-49f6-9340-64b0f9527851 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:39.294040 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-2c809aed-6f6c-49f6-9340-64b0f9527851 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:39.300723 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2c809aed-6f6c-49f6-9340-64b0f9527851 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:39.301390 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2c809aed-6f6c-49f6-9340-64b0f9527851 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:39.303032 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2c809aed-6f6c-49f6-9340-64b0f9527851 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:39.303477 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2c809aed-6f6c-49f6-9340-64b0f9527851 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:39.405532 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-0113fe49-be47-4749-afc7-e2c1d3b02519 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:39.415188 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-0113fe49-be47-4749-afc7-e2c1d3b02519 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c" status: 200 len: 1095 microversion: 2.1 time: 0.142543 Aug 03 19:13:39.415996 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 351/706] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:13:39 2022] GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c => generated 1095 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:13:39.510121 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-2c809aed-6f6c-49f6-9340-64b0f9527851 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:39.526707 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-2c809aed-6f6c-49f6-9340-64b0f9527851 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:39.528247 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-2c809aed-6f6c-49f6-9340-64b0f9527851 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:39.529416 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-2c809aed-6f6c-49f6-9340-64b0f9527851 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1806 microversion: 2.20 time: 0.240134 Aug 03 19:13:39.529984 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 356/707] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:39 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1806 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 19:13:40.437222 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-c9de5614-10a0-4917-9d00-a78a4a4e8e70 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:40.437839 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-c9de5614-10a0-4917-9d00-a78a4a4e8e70 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c125b049-e40d-48d8-99a0-e3113210600c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:40.446114 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c9de5614-10a0-4917-9d00-a78a4a4e8e70 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:40.446569 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c9de5614-10a0-4917-9d00-a78a4a4e8e70 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:40.447369 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c9de5614-10a0-4917-9d00-a78a4a4e8e70 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:40.447805 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c9de5614-10a0-4917-9d00-a78a4a4e8e70 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:40.524876 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-c9de5614-10a0-4917-9d00-a78a4a4e8e70 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:40.537239 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-c9de5614-10a0-4917-9d00-a78a4a4e8e70 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c" status: 200 len: 1137 microversion: 2.1 time: 0.099538 Aug 03 19:13:40.537239 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 352/708] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:13:40 2022] GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c => generated 1137 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:13:40.554847 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-415ac185-a06f-4d6d-8c89-62dd783bd60a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:40.555948 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-415ac185-a06f-4d6d-8c89-62dd783bd60a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:40.566394 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-415ac185-a06f-4d6d-8c89-62dd783bd60a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:40.566394 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-415ac185-a06f-4d6d-8c89-62dd783bd60a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:40.566394 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-415ac185-a06f-4d6d-8c89-62dd783bd60a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:40.566762 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-415ac185-a06f-4d6d-8c89-62dd783bd60a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:40.715602 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-415ac185-a06f-4d6d-8c89-62dd783bd60a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:40.724988 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-415ac185-a06f-4d6d-8c89-62dd783bd60a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:40.726642 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-415ac185-a06f-4d6d-8c89-62dd783bd60a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:40.727878 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-415ac185-a06f-4d6d-8c89-62dd783bd60a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1806 microversion: 2.20 time: 0.177744 Aug 03 19:13:40.728601 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 357/709] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:40 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1806 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:13:41.557809 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-233f404c-5f1c-4cd4-830c-b7154237c427 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:41.558464 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-233f404c-5f1c-4cd4-830c-b7154237c427 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c125b049-e40d-48d8-99a0-e3113210600c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:41.565325 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-233f404c-5f1c-4cd4-830c-b7154237c427 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:41.565779 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-233f404c-5f1c-4cd4-830c-b7154237c427 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:41.566755 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-233f404c-5f1c-4cd4-830c-b7154237c427 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:41.567363 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-233f404c-5f1c-4cd4-830c-b7154237c427 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:41.640521 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-233f404c-5f1c-4cd4-830c-b7154237c427 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:41.649541 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-233f404c-5f1c-4cd4-830c-b7154237c427 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c" status: 200 len: 1211 microversion: 2.1 time: 0.095603 Aug 03 19:13:41.664266 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 353/710] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:13:41 2022] GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c => generated 1211 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:13:41.752126 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-93c31eea-a497-4a4c-8603-cf5681855214 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:41.752822 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-93c31eea-a497-4a4c-8603-cf5681855214 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:41.760538 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-93c31eea-a497-4a4c-8603-cf5681855214 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:41.761063 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-93c31eea-a497-4a4c-8603-cf5681855214 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:41.761906 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-93c31eea-a497-4a4c-8603-cf5681855214 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:41.762601 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-93c31eea-a497-4a4c-8603-cf5681855214 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:41.903710 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-93c31eea-a497-4a4c-8603-cf5681855214 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:41.913420 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-93c31eea-a497-4a4c-8603-cf5681855214 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:41.914979 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-93c31eea-a497-4a4c-8603-cf5681855214 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:41.916272 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-93c31eea-a497-4a4c-8603-cf5681855214 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1806 microversion: 2.20 time: 0.168197 Aug 03 19:13:41.917495 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 358/711] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:41 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:13:42.672995 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-b24aafdc-cb6f-4653-b8c4-317c9b33f43d tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:42.673802 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-b24aafdc-cb6f-4653-b8c4-317c9b33f43d tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c125b049-e40d-48d8-99a0-e3113210600c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:42.681120 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b24aafdc-cb6f-4653-b8c4-317c9b33f43d tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:42.682110 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b24aafdc-cb6f-4653-b8c4-317c9b33f43d tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:42.685141 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b24aafdc-cb6f-4653-b8c4-317c9b33f43d tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:42.685141 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b24aafdc-cb6f-4653-b8c4-317c9b33f43d tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:42.889869 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-b24aafdc-cb6f-4653-b8c4-317c9b33f43d tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:42.898184 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-b24aafdc-cb6f-4653-b8c4-317c9b33f43d tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c" status: 200 len: 1278 microversion: 2.1 time: 0.228968 Aug 03 19:13:42.899101 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 354/712] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:13:42 2022] GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c => generated 1278 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:13:42.945465 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-d8890b12-2839-4c2c-ae60-bbc4cbeb4626 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:42.946093 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-d8890b12-2839-4c2c-ae60-bbc4cbeb4626 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:42.960022 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d8890b12-2839-4c2c-ae60-bbc4cbeb4626 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:42.960471 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d8890b12-2839-4c2c-ae60-bbc4cbeb4626 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:42.961420 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d8890b12-2839-4c2c-ae60-bbc4cbeb4626 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:42.962012 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d8890b12-2839-4c2c-ae60-bbc4cbeb4626 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:43.135680 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-d8890b12-2839-4c2c-ae60-bbc4cbeb4626 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:43.144283 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-d8890b12-2839-4c2c-ae60-bbc4cbeb4626 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:43.146572 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-d8890b12-2839-4c2c-ae60-bbc4cbeb4626 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:43.147772 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-d8890b12-2839-4c2c-ae60-bbc4cbeb4626 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1806 microversion: 2.20 time: 0.207075 Aug 03 19:13:43.148643 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 359/713] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:42 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1806 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:13:43.328995 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-0bbed070-feb0-4371-8b45-bb6eff98b3c9 req-796f4192-6382-4b39-9651-9d8b22a01510 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c125b049-e40d-48d8-99a0-e3113210600c", "tag": "7cb7ee7d-4150-401a-bde3-ea2e666acbf8"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:13:43.339659 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-0bbed070-feb0-4371-8b45-bb6eff98b3c9 req-796f4192-6382-4b39-9651-9d8b22a01510 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:43.340112 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-0bbed070-feb0-4371-8b45-bb6eff98b3c9 req-796f4192-6382-4b39-9651-9d8b22a01510 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:43.361844 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-0bbed070-feb0-4371-8b45-bb6eff98b3c9 req-796f4192-6382-4b39-9651-9d8b22a01510 service nova] Creating event network-changed:7cb7ee7d-4150-401a-bde3-ea2e666acbf8 for instance c125b049-e40d-48d8-99a0-e3113210600c on hv-cinder-85202 Aug 03 19:13:43.367605 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-0bbed070-feb0-4371-8b45-bb6eff98b3c9 req-796f4192-6382-4b39-9651-9d8b22a01510 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042245 Aug 03 19:13:43.372365 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 355/714] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:13:43.920221 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-b92b041a-5847-4fc2-8c13-a281e0a95a34 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:43.921000 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-b92b041a-5847-4fc2-8c13-a281e0a95a34 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c125b049-e40d-48d8-99a0-e3113210600c] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:43.928699 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b92b041a-5847-4fc2-8c13-a281e0a95a34 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:43.929471 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b92b041a-5847-4fc2-8c13-a281e0a95a34 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:43.930321 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b92b041a-5847-4fc2-8c13-a281e0a95a34 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:43.930971 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b92b041a-5847-4fc2-8c13-a281e0a95a34 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:44.075589 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-b92b041a-5847-4fc2-8c13-a281e0a95a34 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:44.079114 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-b92b041a-5847-4fc2-8c13-a281e0a95a34 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c" status: 200 len: 1266 microversion: 2.1 time: 0.163068 Aug 03 19:13:44.079724 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 360/715] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:13:43 2022] GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:13:44.172954 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-5b876066-fea3-4d7c-8259-a52154421aa0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:44.173700 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-5b876066-fea3-4d7c-8259-a52154421aa0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:44.180579 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-5b876066-fea3-4d7c-8259-a52154421aa0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:44.181017 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-5b876066-fea3-4d7c-8259-a52154421aa0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:44.181789 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-5b876066-fea3-4d7c-8259-a52154421aa0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:44.182219 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-5b876066-fea3-4d7c-8259-a52154421aa0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:44.320131 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-5b876066-fea3-4d7c-8259-a52154421aa0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:44.328871 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-5b876066-fea3-4d7c-8259-a52154421aa0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:44.330378 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-5b876066-fea3-4d7c-8259-a52154421aa0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:44.331595 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-5b876066-fea3-4d7c-8259-a52154421aa0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1806 microversion: 2.20 time: 0.163613 Aug 03 19:13:44.332167 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 356/716] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:44 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:13:45.102478 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-5b68731e-2adc-426d-a14a-9ccea36600d3 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:45.103138 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-5b68731e-2adc-426d-a14a-9ccea36600d3 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c125b049-e40d-48d8-99a0-e3113210600c] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:45.109993 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5b68731e-2adc-426d-a14a-9ccea36600d3 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:45.110433 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5b68731e-2adc-426d-a14a-9ccea36600d3 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:45.111227 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5b68731e-2adc-426d-a14a-9ccea36600d3 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:45.111660 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5b68731e-2adc-426d-a14a-9ccea36600d3 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:45.253821 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-5b68731e-2adc-426d-a14a-9ccea36600d3 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:45.258165 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:13:45.262490 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-5b68731e-2adc-426d-a14a-9ccea36600d3 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c" status: 200 len: 1266 microversion: 2.1 time: 0.164676 Aug 03 19:13:45.263068 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 361/717] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:13:45 2022] GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:13:45.355800 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-2ab1aab0-15fa-4396-a04a-cf2171469024 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:45.356351 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-2ab1aab0-15fa-4396-a04a-cf2171469024 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:45.362594 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2ab1aab0-15fa-4396-a04a-cf2171469024 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:45.363068 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2ab1aab0-15fa-4396-a04a-cf2171469024 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:45.363834 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2ab1aab0-15fa-4396-a04a-cf2171469024 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:45.364263 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2ab1aab0-15fa-4396-a04a-cf2171469024 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:45.515871 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-2ab1aab0-15fa-4396-a04a-cf2171469024 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:45.520894 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-2ab1aab0-15fa-4396-a04a-cf2171469024 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:45.522644 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-2ab1aab0-15fa-4396-a04a-cf2171469024 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:45.523867 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-2ab1aab0-15fa-4396-a04a-cf2171469024 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1806 microversion: 2.20 time: 0.172279 Aug 03 19:13:45.524417 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 357/718] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:45 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:13:45.527425 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-72990669-2118-4bbd-9452-c55d18194166 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-952337334", "imageRef": "0b6be242-215e-4886-a0d2-b8d5f8ca623e", "flavorRef": "452", "networks": [{"uuid": "8854b9ff-67e9-4d05-8330-db1a088ab2d8"}]}} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:13:45.583260 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.network.neutron [None req-72990669-2118-4bbd-9452-c55d18194166 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] validate_networks() for [('8854b9ff-67e9-4d05-8330-db1a088ab2d8', None, None, None, None, None)] {{(pid=118303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 19:13:45.936371 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-72990669-2118-4bbd-9452-c55d18194166 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Flavor limits 0:0:0 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 19:13:45.936797 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-72990669-2118-4bbd-9452-c55d18194166 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Image limits 0:0:0 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 19:13:45.937275 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-72990669-2118-4bbd-9452-c55d18194166 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Flavor pref 0:0:0 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 19:13:45.937717 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-72990669-2118-4bbd-9452-c55d18194166 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Image pref 0:0:0 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 19:13:45.938131 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-72990669-2118-4bbd-9452-c55d18194166 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 19:13:45.947488 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-72990669-2118-4bbd-9452-c55d18194166 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:45.947853 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-72990669-2118-4bbd-9452-c55d18194166 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:45.948654 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-72990669-2118-4bbd-9452-c55d18194166 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:45.949092 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-72990669-2118-4bbd-9452-c55d18194166 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:45.966468 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.quota [None req-72990669-2118-4bbd-9452-c55d18194166 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Getting quotas for project bbd9d65265de4d71862e10a916f0a578. Resources: {'instances', 'cores', 'ram'} {{(pid=118303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:13:45.970266 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.quota [None req-72990669-2118-4bbd-9452-c55d18194166 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Getting quotas for user fdd34c15ce88473f97d18a609bb73a5a and project bbd9d65265de4d71862e10a916f0a578. Resources: {'instances', 'cores', 'ram'} {{(pid=118303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:13:45.982210 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-72990669-2118-4bbd-9452-c55d18194166 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Going to run 1 instances... {{(pid=118303) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 19:13:45.984356 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-72990669-2118-4bbd-9452-c55d18194166 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0b6be242-215e-4886-a0d2-b8d5f8ca623e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 19:13:46.159708 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-72990669-2118-4bbd-9452-c55d18194166 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.636661 Aug 03 19:13:46.160671 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 362/719] 10.222.0.77 () {60 vars in 1147 bytes} [Wed Aug 3 19:13:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 19:13:46.172226 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-10c66bf2-c1c3-4518-94bd-fc61993273e1 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:46.172978 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-10c66bf2-c1c3-4518-94bd-fc61993273e1 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:46.233972 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-10c66bf2-c1c3-4518-94bd-fc61993273e1 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd34c15ce88473f97d18a609bb73a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd9d65265de4d71862e10a916f0a578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:46.240417 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-10c66bf2-c1c3-4518-94bd-fc61993273e1 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] 10.222.0.77 "GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae" status: 200 len: 1213 microversion: 2.1 time: 0.072736 Aug 03 19:13:46.241425 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 358/720] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:13:46 2022] GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae => generated 1213 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:13:46.283176 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-4510ce61-c662-4799-900e-dc2dbcd18d06 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:46.283829 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-4510ce61-c662-4799-900e-dc2dbcd18d06 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c125b049-e40d-48d8-99a0-e3113210600c] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:46.290935 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4510ce61-c662-4799-900e-dc2dbcd18d06 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:46.291437 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4510ce61-c662-4799-900e-dc2dbcd18d06 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:46.292234 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4510ce61-c662-4799-900e-dc2dbcd18d06 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:46.292676 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4510ce61-c662-4799-900e-dc2dbcd18d06 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:46.428270 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-4510ce61-c662-4799-900e-dc2dbcd18d06 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:46.435831 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-4510ce61-c662-4799-900e-dc2dbcd18d06 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c" status: 200 len: 1266 microversion: 2.1 time: 0.156674 Aug 03 19:13:46.436395 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 363/721] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:13:46 2022] GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:13:46.547367 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-0309a4a8-04ce-4ad8-901a-64aa33c0f6d6 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:46.547984 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-0309a4a8-04ce-4ad8-901a-64aa33c0f6d6 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:46.555244 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0309a4a8-04ce-4ad8-901a-64aa33c0f6d6 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:46.555700 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0309a4a8-04ce-4ad8-901a-64aa33c0f6d6 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:46.556476 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0309a4a8-04ce-4ad8-901a-64aa33c0f6d6 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:46.556916 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0309a4a8-04ce-4ad8-901a-64aa33c0f6d6 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:46.690917 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-0309a4a8-04ce-4ad8-901a-64aa33c0f6d6 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:46.700983 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-0309a4a8-04ce-4ad8-901a-64aa33c0f6d6 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:46.702505 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-0309a4a8-04ce-4ad8-901a-64aa33c0f6d6 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:46.703686 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-0309a4a8-04ce-4ad8-901a-64aa33c0f6d6 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1806 microversion: 2.20 time: 0.160622 Aug 03 19:13:46.704226 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 359/722] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:46 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:13:47.261161 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-3f6b7a89-ef1c-4711-baae-71fb2235fb51 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:47.261784 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-3f6b7a89-ef1c-4711-baae-71fb2235fb51 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:47.268674 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3f6b7a89-ef1c-4711-baae-71fb2235fb51 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:47.269126 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3f6b7a89-ef1c-4711-baae-71fb2235fb51 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:47.269893 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3f6b7a89-ef1c-4711-baae-71fb2235fb51 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:47.270333 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3f6b7a89-ef1c-4711-baae-71fb2235fb51 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:47.336520 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-3f6b7a89-ef1c-4711-baae-71fb2235fb51 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd34c15ce88473f97d18a609bb73a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd9d65265de4d71862e10a916f0a578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:47.344803 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-3f6b7a89-ef1c-4711-baae-71fb2235fb51 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] 10.222.0.77 "GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae" status: 200 len: 1217 microversion: 2.1 time: 0.087461 Aug 03 19:13:47.345950 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 364/723] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:13:47 2022] GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:13:47.457183 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-39c21f94-06bd-4035-967b-684cbecd04b9 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:47.457832 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-39c21f94-06bd-4035-967b-684cbecd04b9 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c125b049-e40d-48d8-99a0-e3113210600c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:47.464716 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-39c21f94-06bd-4035-967b-684cbecd04b9 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:47.465175 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-39c21f94-06bd-4035-967b-684cbecd04b9 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:47.465979 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-39c21f94-06bd-4035-967b-684cbecd04b9 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:47.466493 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-39c21f94-06bd-4035-967b-684cbecd04b9 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:47.602978 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-39c21f94-06bd-4035-967b-684cbecd04b9 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:47.610789 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-39c21f94-06bd-4035-967b-684cbecd04b9 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c" status: 200 len: 1266 microversion: 2.1 time: 0.157686 Aug 03 19:13:47.611601 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 360/724] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:13:47 2022] GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:13:47.727162 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-d263f257-c7be-4ded-a85e-915e86f37a94 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:47.727683 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-d263f257-c7be-4ded-a85e-915e86f37a94 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:47.733850 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d263f257-c7be-4ded-a85e-915e86f37a94 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:47.734296 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d263f257-c7be-4ded-a85e-915e86f37a94 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:47.735120 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d263f257-c7be-4ded-a85e-915e86f37a94 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:47.735555 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d263f257-c7be-4ded-a85e-915e86f37a94 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:47.877849 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-d263f257-c7be-4ded-a85e-915e86f37a94 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:47.887930 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-d263f257-c7be-4ded-a85e-915e86f37a94 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:47.889511 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-d263f257-c7be-4ded-a85e-915e86f37a94 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:47.890734 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-d263f257-c7be-4ded-a85e-915e86f37a94 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1806 microversion: 2.20 time: 0.168150 Aug 03 19:13:47.891351 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 365/725] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:47 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:13:48.367906 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-0a4539b5-62ed-493d-8660-ec048ffef98d tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:48.368539 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-0a4539b5-62ed-493d-8660-ec048ffef98d tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:48.384574 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0a4539b5-62ed-493d-8660-ec048ffef98d tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:48.385105 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0a4539b5-62ed-493d-8660-ec048ffef98d tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:48.386226 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0a4539b5-62ed-493d-8660-ec048ffef98d tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:48.386935 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0a4539b5-62ed-493d-8660-ec048ffef98d tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:48.459181 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-0a4539b5-62ed-493d-8660-ec048ffef98d tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd34c15ce88473f97d18a609bb73a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd9d65265de4d71862e10a916f0a578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:48.467873 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-0a4539b5-62ed-493d-8660-ec048ffef98d tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] 10.222.0.77 "GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae" status: 200 len: 1273 microversion: 2.1 time: 0.104151 Aug 03 19:13:48.468449 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 361/726] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:13:48 2022] GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae => generated 1273 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:13:48.633757 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-9c9b131b-2145-4ffd-a350-c540a31ea315 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:48.634448 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-9c9b131b-2145-4ffd-a350-c540a31ea315 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c125b049-e40d-48d8-99a0-e3113210600c] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:48.641067 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9c9b131b-2145-4ffd-a350-c540a31ea315 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:48.642895 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9c9b131b-2145-4ffd-a350-c540a31ea315 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:48.642895 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9c9b131b-2145-4ffd-a350-c540a31ea315 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:48.642895 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9c9b131b-2145-4ffd-a350-c540a31ea315 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:48.781821 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-9c9b131b-2145-4ffd-a350-c540a31ea315 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:48.790036 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-9c9b131b-2145-4ffd-a350-c540a31ea315 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c" status: 200 len: 1266 microversion: 2.1 time: 0.161610 Aug 03 19:13:48.790593 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 366/727] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:13:48 2022] GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:13:48.913713 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-9905f760-1c7b-4b1e-ab24-3f5bd6a19b71 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:48.914482 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-9905f760-1c7b-4b1e-ab24-3f5bd6a19b71 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:48.921449 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9905f760-1c7b-4b1e-ab24-3f5bd6a19b71 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:48.921909 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9905f760-1c7b-4b1e-ab24-3f5bd6a19b71 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:48.922691 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9905f760-1c7b-4b1e-ab24-3f5bd6a19b71 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:48.923170 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9905f760-1c7b-4b1e-ab24-3f5bd6a19b71 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:48.928627 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=100 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:13:49.075251 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-9905f760-1c7b-4b1e-ab24-3f5bd6a19b71 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:49.084521 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-9905f760-1c7b-4b1e-ab24-3f5bd6a19b71 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:49.086608 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-9905f760-1c7b-4b1e-ab24-3f5bd6a19b71 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:49.087868 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-9905f760-1c7b-4b1e-ab24-3f5bd6a19b71 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1806 microversion: 2.20 time: 0.178108 Aug 03 19:13:49.088497 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 362/728] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:48 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1806 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:13:49.488644 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-9d56c1d1-3f8b-4ecf-85a8-1056d4b69d24 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:49.489179 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-9d56c1d1-3f8b-4ecf-85a8-1056d4b69d24 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:49.496146 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9d56c1d1-3f8b-4ecf-85a8-1056d4b69d24 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:49.498808 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9d56c1d1-3f8b-4ecf-85a8-1056d4b69d24 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:49.498808 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9d56c1d1-3f8b-4ecf-85a8-1056d4b69d24 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:49.498808 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9d56c1d1-3f8b-4ecf-85a8-1056d4b69d24 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:49.641646 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-9d56c1d1-3f8b-4ecf-85a8-1056d4b69d24 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd34c15ce88473f97d18a609bb73a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd9d65265de4d71862e10a916f0a578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:49.650124 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-9d56c1d1-3f8b-4ecf-85a8-1056d4b69d24 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] 10.222.0.77 "GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae" status: 200 len: 1313 microversion: 2.1 time: 0.165390 Aug 03 19:13:49.650707 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 367/729] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:13:49 2022] GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:13:49.811213 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-c4b3f1a4-9ff4-4ebc-9fc9-672813829426 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:49.811826 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-c4b3f1a4-9ff4-4ebc-9fc9-672813829426 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c125b049-e40d-48d8-99a0-e3113210600c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:49.817770 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c4b3f1a4-9ff4-4ebc-9fc9-672813829426 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:49.818240 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c4b3f1a4-9ff4-4ebc-9fc9-672813829426 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:49.819017 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c4b3f1a4-9ff4-4ebc-9fc9-672813829426 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:49.819450 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c4b3f1a4-9ff4-4ebc-9fc9-672813829426 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:49.957321 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-c4b3f1a4-9ff4-4ebc-9fc9-672813829426 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:49.966414 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-c4b3f1a4-9ff4-4ebc-9fc9-672813829426 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c" status: 200 len: 1266 microversion: 2.1 time: 0.159021 Aug 03 19:13:49.968560 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 363/730] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:13:49 2022] GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:13:50.111779 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-5f207c81-9cd5-498d-9bac-6eca0f7a174c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:50.112404 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-5f207c81-9cd5-498d-9bac-6eca0f7a174c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:50.119446 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5f207c81-9cd5-498d-9bac-6eca0f7a174c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:50.120232 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5f207c81-9cd5-498d-9bac-6eca0f7a174c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:50.122440 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5f207c81-9cd5-498d-9bac-6eca0f7a174c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:50.122440 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5f207c81-9cd5-498d-9bac-6eca0f7a174c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:50.250683 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-3cb32470-0471-4371-af93-0e5969a8ba24 req-0421d352-9883-4dc1-8248-0184fe300bd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e21c8ef-c172-41cd-806e-f69f81116b6a", "name": "network-vif-plugged", "status": "completed", "tag": "5bac2969-4e88-4008-93e1-3408ccc91cbb"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:13:50.263022 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-3cb32470-0471-4371-af93-0e5969a8ba24 req-0421d352-9883-4dc1-8248-0184fe300bd0 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:50.263476 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-3cb32470-0471-4371-af93-0e5969a8ba24 req-0421d352-9883-4dc1-8248-0184fe300bd0 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:50.274977 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-3cb32470-0471-4371-af93-0e5969a8ba24 req-0421d352-9883-4dc1-8248-0184fe300bd0 service nova] Creating event network-vif-plugged:5bac2969-4e88-4008-93e1-3408ccc91cbb for instance 2e21c8ef-c172-41cd-806e-f69f81116b6a on hv-cinder-85202 Aug 03 19:13:50.279997 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-3cb32470-0471-4371-af93-0e5969a8ba24 req-0421d352-9883-4dc1-8248-0184fe300bd0 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045841 Aug 03 19:13:50.280524 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 364/731] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 19:13:50.283317 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-5f207c81-9cd5-498d-9bac-6eca0f7a174c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:50.291816 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-5f207c81-9cd5-498d-9bac-6eca0f7a174c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:50.296473 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-5f207c81-9cd5-498d-9bac-6eca0f7a174c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:50.296473 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-5f207c81-9cd5-498d-9bac-6eca0f7a174c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1806 microversion: 2.20 time: 0.187210 Aug 03 19:13:50.296473 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 368/732] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:50 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1806 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:13:50.379902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-5632285d-e3be-4467-ba63-d28c473e97c1 req-31d5bd9c-9e0d-477e-9328-19fb7cb79f07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae", "tag": "f4e90580-2d35-42fd-87bb-4e0cca41dbb7"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:13:50.391580 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-5632285d-e3be-4467-ba63-d28c473e97c1 req-31d5bd9c-9e0d-477e-9328-19fb7cb79f07 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:50.392265 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-5632285d-e3be-4467-ba63-d28c473e97c1 req-31d5bd9c-9e0d-477e-9328-19fb7cb79f07 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:50.405145 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-5632285d-e3be-4467-ba63-d28c473e97c1 req-31d5bd9c-9e0d-477e-9328-19fb7cb79f07 service nova] Creating event network-changed:f4e90580-2d35-42fd-87bb-4e0cca41dbb7 for instance 3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae on hv-cinder-85202 Aug 03 19:13:50.413606 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-5632285d-e3be-4467-ba63-d28c473e97c1 req-31d5bd9c-9e0d-477e-9328-19fb7cb79f07 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037701 Aug 03 19:13:50.414592 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 365/733] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:13:50.671217 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-29329e26-b293-4c0b-934f-94a08d5d42da tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:50.671743 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-29329e26-b293-4c0b-934f-94a08d5d42da tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:50.678196 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-29329e26-b293-4c0b-934f-94a08d5d42da tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:50.678646 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-29329e26-b293-4c0b-934f-94a08d5d42da tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:50.680001 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-29329e26-b293-4c0b-934f-94a08d5d42da tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:50.680445 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-29329e26-b293-4c0b-934f-94a08d5d42da tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:50.827567 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-29329e26-b293-4c0b-934f-94a08d5d42da tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd34c15ce88473f97d18a609bb73a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd9d65265de4d71862e10a916f0a578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:50.835386 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-29329e26-b293-4c0b-934f-94a08d5d42da tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] 10.222.0.77 "GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae" status: 200 len: 1313 microversion: 2.1 time: 0.168304 Aug 03 19:13:50.835958 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 369/734] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:13:50 2022] GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:13:50.988174 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-408082e7-51ff-4885-8312-716eac91cc7a tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:50.988862 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-408082e7-51ff-4885-8312-716eac91cc7a tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c125b049-e40d-48d8-99a0-e3113210600c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:50.995536 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-408082e7-51ff-4885-8312-716eac91cc7a tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:50.995980 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-408082e7-51ff-4885-8312-716eac91cc7a tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:50.996758 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-408082e7-51ff-4885-8312-716eac91cc7a tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:50.997189 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-408082e7-51ff-4885-8312-716eac91cc7a tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:51.139575 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-408082e7-51ff-4885-8312-716eac91cc7a tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:51.147312 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-408082e7-51ff-4885-8312-716eac91cc7a tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c" status: 200 len: 1266 microversion: 2.1 time: 0.163880 Aug 03 19:13:51.148586 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 366/735] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:13:50 2022] GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:13:51.318288 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-9df3e97b-413b-487a-a2c3-074802f8ec2b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:51.318901 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-9df3e97b-413b-487a-a2c3-074802f8ec2b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:51.325575 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9df3e97b-413b-487a-a2c3-074802f8ec2b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:51.326017 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9df3e97b-413b-487a-a2c3-074802f8ec2b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:51.326789 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9df3e97b-413b-487a-a2c3-074802f8ec2b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:51.327250 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9df3e97b-413b-487a-a2c3-074802f8ec2b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:51.459809 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-9df3e97b-413b-487a-a2c3-074802f8ec2b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:51.469065 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-9df3e97b-413b-487a-a2c3-074802f8ec2b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:51.470561 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-9df3e97b-413b-487a-a2c3-074802f8ec2b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:51.471744 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-9df3e97b-413b-487a-a2c3-074802f8ec2b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1806 microversion: 2.20 time: 0.157393 Aug 03 19:13:51.472310 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 370/736] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:51 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:13:51.856794 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-d10371bb-7a48-4454-8573-6d0148c08e41 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:51.857401 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-d10371bb-7a48-4454-8573-6d0148c08e41 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:51.863398 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d10371bb-7a48-4454-8573-6d0148c08e41 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:51.863863 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d10371bb-7a48-4454-8573-6d0148c08e41 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:51.864610 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d10371bb-7a48-4454-8573-6d0148c08e41 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:51.865047 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d10371bb-7a48-4454-8573-6d0148c08e41 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:51.993932 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-d10371bb-7a48-4454-8573-6d0148c08e41 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd34c15ce88473f97d18a609bb73a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd9d65265de4d71862e10a916f0a578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:52.001768 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-d10371bb-7a48-4454-8573-6d0148c08e41 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] 10.222.0.77 "GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae" status: 200 len: 1313 microversion: 2.1 time: 0.149054 Aug 03 19:13:52.002398 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 367/737] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:13:51 2022] GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:13:52.168344 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-10bde327-cc4f-4e03-ae1e-b905927001cd tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:52.168962 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-10bde327-cc4f-4e03-ae1e-b905927001cd tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c125b049-e40d-48d8-99a0-e3113210600c] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:52.175547 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-10bde327-cc4f-4e03-ae1e-b905927001cd tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:52.175999 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-10bde327-cc4f-4e03-ae1e-b905927001cd tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:52.176767 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-10bde327-cc4f-4e03-ae1e-b905927001cd tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:52.177204 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-10bde327-cc4f-4e03-ae1e-b905927001cd tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:52.317813 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-10bde327-cc4f-4e03-ae1e-b905927001cd tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:52.326183 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-10bde327-cc4f-4e03-ae1e-b905927001cd tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c" status: 200 len: 1266 microversion: 2.1 time: 0.162080 Aug 03 19:13:52.326762 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 371/738] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:13:52 2022] GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:13:52.495557 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-ce633de0-7c38-4203-a01b-ee3c566db602 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:52.496203 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-ce633de0-7c38-4203-a01b-ee3c566db602 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:52.502743 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ce633de0-7c38-4203-a01b-ee3c566db602 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:52.503171 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ce633de0-7c38-4203-a01b-ee3c566db602 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:52.503943 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ce633de0-7c38-4203-a01b-ee3c566db602 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:52.504381 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ce633de0-7c38-4203-a01b-ee3c566db602 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:52.634362 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-ce633de0-7c38-4203-a01b-ee3c566db602 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:52.642734 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-ce633de0-7c38-4203-a01b-ee3c566db602 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:52.644276 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-ce633de0-7c38-4203-a01b-ee3c566db602 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:52.645431 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-ce633de0-7c38-4203-a01b-ee3c566db602 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1806 microversion: 2.20 time: 0.154876 Aug 03 19:13:52.645986 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 368/739] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:52 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:13:53.031852 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-23d2097d-4854-4c50-82c6-bf59ceecc596 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:53.032456 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-23d2097d-4854-4c50-82c6-bf59ceecc596 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:53.038501 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-23d2097d-4854-4c50-82c6-bf59ceecc596 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:53.038955 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-23d2097d-4854-4c50-82c6-bf59ceecc596 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:53.041014 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-23d2097d-4854-4c50-82c6-bf59ceecc596 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:53.041447 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-23d2097d-4854-4c50-82c6-bf59ceecc596 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:53.173964 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-23d2097d-4854-4c50-82c6-bf59ceecc596 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd34c15ce88473f97d18a609bb73a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd9d65265de4d71862e10a916f0a578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:53.184075 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-23d2097d-4854-4c50-82c6-bf59ceecc596 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] 10.222.0.77 "GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae" status: 200 len: 1313 microversion: 2.1 time: 0.156099 Aug 03 19:13:53.184661 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 372/740] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:13:53 2022] GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:13:53.347056 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-8533e3c8-056c-4b43-b3e2-c6f4cc8c5dff tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:53.347627 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-8533e3c8-056c-4b43-b3e2-c6f4cc8c5dff tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c125b049-e40d-48d8-99a0-e3113210600c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:53.354223 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8533e3c8-056c-4b43-b3e2-c6f4cc8c5dff tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:53.354667 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8533e3c8-056c-4b43-b3e2-c6f4cc8c5dff tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:53.355470 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8533e3c8-056c-4b43-b3e2-c6f4cc8c5dff tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:53.355907 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8533e3c8-056c-4b43-b3e2-c6f4cc8c5dff tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:53.495342 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-8533e3c8-056c-4b43-b3e2-c6f4cc8c5dff tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:53.508325 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-8533e3c8-056c-4b43-b3e2-c6f4cc8c5dff tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c" status: 200 len: 1266 microversion: 2.1 time: 0.165102 Aug 03 19:13:53.508995 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 369/741] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:13:53 2022] GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:13:53.667927 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-b5b70f76-8928-4a7b-a080-922a81a957d6 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:53.669320 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-b5b70f76-8928-4a7b-a080-922a81a957d6 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:53.675437 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b5b70f76-8928-4a7b-a080-922a81a957d6 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:53.675887 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b5b70f76-8928-4a7b-a080-922a81a957d6 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:53.676695 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b5b70f76-8928-4a7b-a080-922a81a957d6 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:53.677133 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b5b70f76-8928-4a7b-a080-922a81a957d6 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:53.813779 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-b5b70f76-8928-4a7b-a080-922a81a957d6 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:53.823660 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-b5b70f76-8928-4a7b-a080-922a81a957d6 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:53.825155 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-b5b70f76-8928-4a7b-a080-922a81a957d6 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:53.826296 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-b5b70f76-8928-4a7b-a080-922a81a957d6 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1806 microversion: 2.20 time: 0.162378 Aug 03 19:13:53.826845 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 373/742] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:53 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:13:54.206007 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-9285aeaf-e5e9-4e9b-8a5b-9a693054cb18 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:54.206686 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-9285aeaf-e5e9-4e9b-8a5b-9a693054cb18 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:54.213179 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9285aeaf-e5e9-4e9b-8a5b-9a693054cb18 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:54.213638 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9285aeaf-e5e9-4e9b-8a5b-9a693054cb18 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:54.214573 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9285aeaf-e5e9-4e9b-8a5b-9a693054cb18 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:54.215132 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9285aeaf-e5e9-4e9b-8a5b-9a693054cb18 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:54.371603 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-9285aeaf-e5e9-4e9b-8a5b-9a693054cb18 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd34c15ce88473f97d18a609bb73a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd9d65265de4d71862e10a916f0a578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:54.379684 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-9285aeaf-e5e9-4e9b-8a5b-9a693054cb18 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] 10.222.0.77 "GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae" status: 200 len: 1313 microversion: 2.1 time: 0.177750 Aug 03 19:13:54.380257 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 370/743] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:13:54 2022] GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:13:54.529341 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-09393ab3-7ffd-4c70-9ddd-391b1c8681c9 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:54.529970 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-09393ab3-7ffd-4c70-9ddd-391b1c8681c9 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c125b049-e40d-48d8-99a0-e3113210600c] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:54.538977 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-09393ab3-7ffd-4c70-9ddd-391b1c8681c9 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:54.540742 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-09393ab3-7ffd-4c70-9ddd-391b1c8681c9 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:54.541593 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-09393ab3-7ffd-4c70-9ddd-391b1c8681c9 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:54.542153 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-09393ab3-7ffd-4c70-9ddd-391b1c8681c9 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:54.706142 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-09393ab3-7ffd-4c70-9ddd-391b1c8681c9 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:54.714671 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-09393ab3-7ffd-4c70-9ddd-391b1c8681c9 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c" status: 200 len: 1266 microversion: 2.1 time: 0.189428 Aug 03 19:13:54.715691 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 374/744] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:13:54 2022] GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:13:54.850861 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-eaf407e6-9b37-48b3-9f63-fcc95c8cf7f0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:54.851503 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-eaf407e6-9b37-48b3-9f63-fcc95c8cf7f0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:54.858388 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-eaf407e6-9b37-48b3-9f63-fcc95c8cf7f0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:54.858827 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-eaf407e6-9b37-48b3-9f63-fcc95c8cf7f0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:54.859627 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-eaf407e6-9b37-48b3-9f63-fcc95c8cf7f0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:54.860068 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-eaf407e6-9b37-48b3-9f63-fcc95c8cf7f0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:54.999452 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-eaf407e6-9b37-48b3-9f63-fcc95c8cf7f0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:55.008153 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-eaf407e6-9b37-48b3-9f63-fcc95c8cf7f0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:55.009781 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-eaf407e6-9b37-48b3-9f63-fcc95c8cf7f0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:55.011035 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-eaf407e6-9b37-48b3-9f63-fcc95c8cf7f0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1806 microversion: 2.20 time: 0.164007 Aug 03 19:13:55.012185 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 371/745] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:54 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1806 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:13:55.401189 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-5ab4fd34-e22d-471b-b506-2a3c014bc84e tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:55.401792 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-5ab4fd34-e22d-471b-b506-2a3c014bc84e tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:55.407809 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5ab4fd34-e22d-471b-b506-2a3c014bc84e tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:55.408255 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5ab4fd34-e22d-471b-b506-2a3c014bc84e tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:55.409009 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5ab4fd34-e22d-471b-b506-2a3c014bc84e tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:55.409438 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5ab4fd34-e22d-471b-b506-2a3c014bc84e tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:55.539061 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-5ab4fd34-e22d-471b-b506-2a3c014bc84e tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd34c15ce88473f97d18a609bb73a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd9d65265de4d71862e10a916f0a578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:55.547290 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-5ab4fd34-e22d-471b-b506-2a3c014bc84e tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] 10.222.0.77 "GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae" status: 200 len: 1313 microversion: 2.1 time: 0.150855 Aug 03 19:13:55.547851 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 375/746] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:13:55 2022] GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:13:55.741716 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-3b585da3-c1e9-491d-9ade-abc52f8e98e2 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:55.742316 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-3b585da3-c1e9-491d-9ade-abc52f8e98e2 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c125b049-e40d-48d8-99a0-e3113210600c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:55.748991 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3b585da3-c1e9-491d-9ade-abc52f8e98e2 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:55.749436 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3b585da3-c1e9-491d-9ade-abc52f8e98e2 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:55.750220 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3b585da3-c1e9-491d-9ade-abc52f8e98e2 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:55.750661 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3b585da3-c1e9-491d-9ade-abc52f8e98e2 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:55.890055 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-3b585da3-c1e9-491d-9ade-abc52f8e98e2 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:55.897738 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-3b585da3-c1e9-491d-9ade-abc52f8e98e2 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c" status: 200 len: 1266 microversion: 2.1 time: 0.159862 Aug 03 19:13:55.898323 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 372/747] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:13:55 2022] GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:13:56.035451 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-c713a21d-431e-4fb4-a2f7-4932244e2f33 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:56.036113 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-c713a21d-431e-4fb4-a2f7-4932244e2f33 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:56.037954 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell0:SELECT=4 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:13:56.038606 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell0:SELECT=12 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:13:56.044325 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c713a21d-431e-4fb4-a2f7-4932244e2f33 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:56.044768 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c713a21d-431e-4fb4-a2f7-4932244e2f33 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:56.045529 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c713a21d-431e-4fb4-a2f7-4932244e2f33 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:56.045960 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c713a21d-431e-4fb4-a2f7-4932244e2f33 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:56.182811 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-c713a21d-431e-4fb4-a2f7-4932244e2f33 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:56.191706 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-c713a21d-431e-4fb4-a2f7-4932244e2f33 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:56.193211 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-c713a21d-431e-4fb4-a2f7-4932244e2f33 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:56.194405 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-c713a21d-431e-4fb4-a2f7-4932244e2f33 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1806 microversion: 2.20 time: 0.162836 Aug 03 19:13:56.195178 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 376/748] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:56 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:13:56.306604 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell0:SELECT=4 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:13:56.310722 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-2854eb2a-7034-4261-9815-d365547f46ae req-90863e18-abc0-461c-98b3-18793528d436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c125b049-e40d-48d8-99a0-e3113210600c", "name": "network-vif-plugged", "status": "completed", "tag": "7cb7ee7d-4150-401a-bde3-ea2e666acbf8"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:13:56.316003 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_api:SELECT=60 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:13:56.322929 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-2854eb2a-7034-4261-9815-d365547f46ae req-90863e18-abc0-461c-98b3-18793528d436 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:56.323404 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-2854eb2a-7034-4261-9815-d365547f46ae req-90863e18-abc0-461c-98b3-18793528d436 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:56.335092 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-2854eb2a-7034-4261-9815-d365547f46ae req-90863e18-abc0-461c-98b3-18793528d436 service nova] Creating event network-vif-plugged:7cb7ee7d-4150-401a-bde3-ea2e666acbf8 for instance c125b049-e40d-48d8-99a0-e3113210600c on hv-cinder-85202 Aug 03 19:13:56.340417 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-2854eb2a-7034-4261-9815-d365547f46ae req-90863e18-abc0-461c-98b3-18793528d436 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035261 Aug 03 19:13:56.341021 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 373/749] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:13:56.567185 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-35e3d774-3189-48e9-82e2-c136cda8babd tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:56.567826 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-35e3d774-3189-48e9-82e2-c136cda8babd tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:56.575022 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-35e3d774-3189-48e9-82e2-c136cda8babd tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:56.575478 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-35e3d774-3189-48e9-82e2-c136cda8babd tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:56.576251 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-35e3d774-3189-48e9-82e2-c136cda8babd tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:56.576691 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-35e3d774-3189-48e9-82e2-c136cda8babd tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:56.709303 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-35e3d774-3189-48e9-82e2-c136cda8babd tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd34c15ce88473f97d18a609bb73a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd9d65265de4d71862e10a916f0a578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:56.717993 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-35e3d774-3189-48e9-82e2-c136cda8babd tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] 10.222.0.77 "GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae" status: 200 len: 1313 microversion: 2.1 time: 0.154660 Aug 03 19:13:56.718767 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 377/750] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:13:56 2022] GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:13:56.921028 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-dd03ea9b-e98c-4c12-95ae-79b862e9cdc5 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:56.921729 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-dd03ea9b-e98c-4c12-95ae-79b862e9cdc5 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c125b049-e40d-48d8-99a0-e3113210600c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:56.928834 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-dd03ea9b-e98c-4c12-95ae-79b862e9cdc5 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:56.929343 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-dd03ea9b-e98c-4c12-95ae-79b862e9cdc5 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:56.930729 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-dd03ea9b-e98c-4c12-95ae-79b862e9cdc5 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:56.931347 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-dd03ea9b-e98c-4c12-95ae-79b862e9cdc5 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:57.078621 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-dd03ea9b-e98c-4c12-95ae-79b862e9cdc5 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:57.087011 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-dd03ea9b-e98c-4c12-95ae-79b862e9cdc5 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c" status: 200 len: 1266 microversion: 2.1 time: 0.171131 Aug 03 19:13:57.087585 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 374/751] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:13:56 2022] GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:13:57.218612 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-2161994a-8365-4731-b931-844aaad59355 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:57.219257 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-2161994a-8365-4731-b931-844aaad59355 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:57.225744 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2161994a-8365-4731-b931-844aaad59355 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:57.226281 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2161994a-8365-4731-b931-844aaad59355 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:57.227221 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2161994a-8365-4731-b931-844aaad59355 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:57.228164 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2161994a-8365-4731-b931-844aaad59355 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:57.360833 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-2161994a-8365-4731-b931-844aaad59355 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:57.369574 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-2161994a-8365-4731-b931-844aaad59355 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:57.371125 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-2161994a-8365-4731-b931-844aaad59355 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:57.372263 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-2161994a-8365-4731-b931-844aaad59355 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1793 microversion: 2.20 time: 0.157812 Aug 03 19:13:57.372814 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 378/752] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:13:57 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1793 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:13:57.745530 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-f4ac6351-ae5a-4af9-a7e1-77106c29e0fb tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:57.746146 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-f4ac6351-ae5a-4af9-a7e1-77106c29e0fb tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:57.752247 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f4ac6351-ae5a-4af9-a7e1-77106c29e0fb tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:57.752700 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f4ac6351-ae5a-4af9-a7e1-77106c29e0fb tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:57.753471 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f4ac6351-ae5a-4af9-a7e1-77106c29e0fb tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:57.753912 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f4ac6351-ae5a-4af9-a7e1-77106c29e0fb tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:57.885801 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-f4ac6351-ae5a-4af9-a7e1-77106c29e0fb tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd34c15ce88473f97d18a609bb73a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd9d65265de4d71862e10a916f0a578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:57.894238 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-f4ac6351-ae5a-4af9-a7e1-77106c29e0fb tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] 10.222.0.77 "GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae" status: 200 len: 1313 microversion: 2.1 time: 0.153022 Aug 03 19:13:57.894737 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 375/753] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:13:57 2022] GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:13:58.108076 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-e672207e-3c6c-4f98-b228-943dc49dcc3c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:58.108661 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-e672207e-3c6c-4f98-b228-943dc49dcc3c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c125b049-e40d-48d8-99a0-e3113210600c] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:58.115148 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e672207e-3c6c-4f98-b228-943dc49dcc3c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:58.115600 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e672207e-3c6c-4f98-b228-943dc49dcc3c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:58.116395 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e672207e-3c6c-4f98-b228-943dc49dcc3c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:58.116830 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e672207e-3c6c-4f98-b228-943dc49dcc3c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:58.121901 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=100 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:13:58.254240 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-e672207e-3c6c-4f98-b228-943dc49dcc3c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:58.262046 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-e672207e-3c6c-4f98-b228-943dc49dcc3c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c" status: 200 len: 1266 microversion: 2.1 time: 0.157767 Aug 03 19:13:58.262634 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 379/754] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:13:58 2022] GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:13:58.915602 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-2350e1a6-1f5a-4774-ad26-eecc5ddb283c tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:58.916312 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-2350e1a6-1f5a-4774-ad26-eecc5ddb283c tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:58.924840 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2350e1a6-1f5a-4774-ad26-eecc5ddb283c tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:58.925344 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2350e1a6-1f5a-4774-ad26-eecc5ddb283c tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:58.926382 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2350e1a6-1f5a-4774-ad26-eecc5ddb283c tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:58.927056 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2350e1a6-1f5a-4774-ad26-eecc5ddb283c tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:59.069652 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-2350e1a6-1f5a-4774-ad26-eecc5ddb283c tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd34c15ce88473f97d18a609bb73a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd9d65265de4d71862e10a916f0a578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:59.077678 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-2350e1a6-1f5a-4774-ad26-eecc5ddb283c tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] 10.222.0.77 "GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae" status: 200 len: 1313 microversion: 2.1 time: 0.166558 Aug 03 19:13:59.078246 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 376/755] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:13:58 2022] GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:13:59.282653 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-8d029408-620b-473a-b7af-acf920c60b15 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:59.283308 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-8d029408-620b-473a-b7af-acf920c60b15 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c125b049-e40d-48d8-99a0-e3113210600c] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:59.290185 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8d029408-620b-473a-b7af-acf920c60b15 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:59.290635 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8d029408-620b-473a-b7af-acf920c60b15 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:59.291505 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8d029408-620b-473a-b7af-acf920c60b15 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:59.291947 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8d029408-620b-473a-b7af-acf920c60b15 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:59.431645 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-8d029408-620b-473a-b7af-acf920c60b15 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:59.439795 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-8d029408-620b-473a-b7af-acf920c60b15 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c" status: 200 len: 1452 microversion: 2.1 time: 0.161010 Aug 03 19:13:59.440365 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 380/756] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:13:59 2022] GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:13:59.461102 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-ce7eb476-dae1-49aa-a94d-d096187926b6 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:13:59.461692 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-ce7eb476-dae1-49aa-a94d-d096187926b6 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c125b049-e40d-48d8-99a0-e3113210600c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:13:59.468356 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ce7eb476-dae1-49aa-a94d-d096187926b6 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:59.475451 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ce7eb476-dae1-49aa-a94d-d096187926b6 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:59.475451 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ce7eb476-dae1-49aa-a94d-d096187926b6 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:13:59.475451 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ce7eb476-dae1-49aa-a94d-d096187926b6 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:13:59.606303 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-ce7eb476-dae1-49aa-a94d-d096187926b6 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:13:59.614041 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-ce7eb476-dae1-49aa-a94d-d096187926b6 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c" status: 200 len: 1452 microversion: 2.1 time: 0.156914 Aug 03 19:13:59.614611 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 377/757] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:13:59 2022] GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:14:00.098246 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-d009a8db-d7d7-4823-937a-f13cc94a8d62 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:14:00.099695 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-d009a8db-d7d7-4823-937a-f13cc94a8d62 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:14:00.106277 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d009a8db-d7d7-4823-937a-f13cc94a8d62 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:00.106726 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d009a8db-d7d7-4823-937a-f13cc94a8d62 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:00.107639 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d009a8db-d7d7-4823-937a-f13cc94a8d62 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:00.108071 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d009a8db-d7d7-4823-937a-f13cc94a8d62 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:00.256178 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-d009a8db-d7d7-4823-937a-f13cc94a8d62 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd34c15ce88473f97d18a609bb73a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd9d65265de4d71862e10a916f0a578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:14:00.261446 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-d009a8db-d7d7-4823-937a-f13cc94a8d62 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] 10.222.0.77 "GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae" status: 200 len: 1313 microversion: 2.1 time: 0.167034 Aug 03 19:14:00.262483 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 381/758] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:14:00 2022] GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:14:00.341878 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-0154131d-84da-4556-abab-94f71c8cb2eb req-5a21cc0b-21c7-47d1-91f5-7f25bebc9375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae", "name": "network-vif-plugged", "status": "completed", "tag": "f4e90580-2d35-42fd-87bb-4e0cca41dbb7"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:14:00.353838 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-0154131d-84da-4556-abab-94f71c8cb2eb req-5a21cc0b-21c7-47d1-91f5-7f25bebc9375 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:00.354377 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-0154131d-84da-4556-abab-94f71c8cb2eb req-5a21cc0b-21c7-47d1-91f5-7f25bebc9375 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:00.367736 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-0154131d-84da-4556-abab-94f71c8cb2eb req-5a21cc0b-21c7-47d1-91f5-7f25bebc9375 service nova] Creating event network-vif-plugged:f4e90580-2d35-42fd-87bb-4e0cca41dbb7 for instance 3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae on hv-cinder-85202 Aug 03 19:14:00.373508 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-0154131d-84da-4556-abab-94f71c8cb2eb req-5a21cc0b-21c7-47d1-91f5-7f25bebc9375 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035084 Aug 03 19:14:00.374614 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 378/759] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:14:01.283223 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-900a2357-509c-44ff-8e79-622a8a08588b tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:14:01.284470 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-900a2357-509c-44ff-8e79-622a8a08588b tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:14:01.291906 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-900a2357-509c-44ff-8e79-622a8a08588b tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:01.292357 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-900a2357-509c-44ff-8e79-622a8a08588b tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:01.293387 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-900a2357-509c-44ff-8e79-622a8a08588b tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:01.293836 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-900a2357-509c-44ff-8e79-622a8a08588b tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:01.428551 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-900a2357-509c-44ff-8e79-622a8a08588b tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd34c15ce88473f97d18a609bb73a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd9d65265de4d71862e10a916f0a578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:14:01.437587 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-900a2357-509c-44ff-8e79-622a8a08588b tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] 10.222.0.77 "GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae" status: 200 len: 1313 microversion: 2.1 time: 0.158455 Aug 03 19:14:01.438701 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 382/760] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:14:01 2022] GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:14:02.131442 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-aaab6ac9-858d-45c6-95d6-c86e53d1ab34 req-9c7dfa72-6b48-4eee-9e26-4648d820aae2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c125b049-e40d-48d8-99a0-e3113210600c", "tag": "7cb7ee7d-4150-401a-bde3-ea2e666acbf8"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:14:02.141989 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-aaab6ac9-858d-45c6-95d6-c86e53d1ab34 req-9c7dfa72-6b48-4eee-9e26-4648d820aae2 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:02.142774 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-aaab6ac9-858d-45c6-95d6-c86e53d1ab34 req-9c7dfa72-6b48-4eee-9e26-4648d820aae2 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:02.154610 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-aaab6ac9-858d-45c6-95d6-c86e53d1ab34 req-9c7dfa72-6b48-4eee-9e26-4648d820aae2 service nova] Creating event network-changed:7cb7ee7d-4150-401a-bde3-ea2e666acbf8 for instance c125b049-e40d-48d8-99a0-e3113210600c on hv-cinder-85202 Aug 03 19:14:02.159467 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-aaab6ac9-858d-45c6-95d6-c86e53d1ab34 req-9c7dfa72-6b48-4eee-9e26-4648d820aae2 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162699 Aug 03 19:14:02.160120 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 379/761] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:14:02.465513 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-ebb87720-3a37-48ad-947c-68e45133ff95 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:14:02.466131 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-ebb87720-3a37-48ad-947c-68e45133ff95 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:14:02.473088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ebb87720-3a37-48ad-947c-68e45133ff95 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:02.473530 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ebb87720-3a37-48ad-947c-68e45133ff95 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:02.474299 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ebb87720-3a37-48ad-947c-68e45133ff95 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:02.474728 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ebb87720-3a37-48ad-947c-68e45133ff95 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:02.618154 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-ebb87720-3a37-48ad-947c-68e45133ff95 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd34c15ce88473f97d18a609bb73a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd9d65265de4d71862e10a916f0a578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:14:02.626247 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-ebb87720-3a37-48ad-947c-68e45133ff95 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] 10.222.0.77 "GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae" status: 200 len: 1313 microversion: 2.1 time: 0.165431 Aug 03 19:14:02.626819 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 383/762] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:14:02 2022] GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:14:03.649113 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-66f26848-7c81-478f-b5b0-b41345f5904d tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:14:03.650023 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-66f26848-7c81-478f-b5b0-b41345f5904d tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:14:03.656162 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-66f26848-7c81-478f-b5b0-b41345f5904d tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:03.656619 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-66f26848-7c81-478f-b5b0-b41345f5904d tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:03.657385 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-66f26848-7c81-478f-b5b0-b41345f5904d tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:03.657821 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-66f26848-7c81-478f-b5b0-b41345f5904d tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:03.792212 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-66f26848-7c81-478f-b5b0-b41345f5904d tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd34c15ce88473f97d18a609bb73a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd9d65265de4d71862e10a916f0a578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:14:03.800028 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-66f26848-7c81-478f-b5b0-b41345f5904d tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] 10.222.0.77 "GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae" status: 200 len: 1496 microversion: 2.1 time: 0.156239 Aug 03 19:14:03.800593 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 380/763] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:14:03 2022] GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae => generated 1496 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:14:04.732285 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-a5828794-e01f-4d6d-9b45-c04d30ac050b tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:14:04.732818 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-a5828794-e01f-4d6d-9b45-c04d30ac050b tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:14:04.739412 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a5828794-e01f-4d6d-9b45-c04d30ac050b tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:04.739856 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a5828794-e01f-4d6d-9b45-c04d30ac050b tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:04.740613 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a5828794-e01f-4d6d-9b45-c04d30ac050b tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:04.741077 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a5828794-e01f-4d6d-9b45-c04d30ac050b tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:04.766307 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-a5828794-e01f-4d6d-9b45-c04d30ac050b tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae] Going to try to terminate instance {{(pid=118303) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 19:14:05.036998 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-a5828794-e01f-4d6d-9b45-c04d30ac050b tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] 10.222.0.77 "DELETE /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae" status: 204 len: 0 microversion: 2.1 time: 0.308251 Aug 03 19:14:05.037596 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 384/764] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 3 19:14:04 2022] DELETE /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 19:14:05.046498 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-756a1933-5fb6-4a90-9930-676d1d39d67d tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:14:05.047154 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-756a1933-5fb6-4a90-9930-676d1d39d67d tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:14:05.053820 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-756a1933-5fb6-4a90-9930-676d1d39d67d tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:05.054263 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-756a1933-5fb6-4a90-9930-676d1d39d67d tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:05.055411 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-756a1933-5fb6-4a90-9930-676d1d39d67d tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:05.055880 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-756a1933-5fb6-4a90-9930-676d1d39d67d tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:05.188422 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-756a1933-5fb6-4a90-9930-676d1d39d67d tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd34c15ce88473f97d18a609bb73a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd9d65265de4d71862e10a916f0a578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:14:05.196873 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-756a1933-5fb6-4a90-9930-676d1d39d67d tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] 10.222.0.77 "GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae" status: 200 len: 1502 microversion: 2.1 time: 0.154232 Aug 03 19:14:05.197447 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 381/765] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:14:05 2022] GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:14:06.218471 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-ba20c516-dbcd-42da-a610-23551d0ee3ba tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:14:06.219204 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-ba20c516-dbcd-42da-a610-23551d0ee3ba tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:14:06.225868 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ba20c516-dbcd-42da-a610-23551d0ee3ba tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:06.226321 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ba20c516-dbcd-42da-a610-23551d0ee3ba tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:06.227254 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ba20c516-dbcd-42da-a610-23551d0ee3ba tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:06.227693 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ba20c516-dbcd-42da-a610-23551d0ee3ba tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:06.360811 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-ba20c516-dbcd-42da-a610-23551d0ee3ba tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd34c15ce88473f97d18a609bb73a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd9d65265de4d71862e10a916f0a578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:14:06.369465 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-ba20c516-dbcd-42da-a610-23551d0ee3ba tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] 10.222.0.77 "GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae" status: 200 len: 1502 microversion: 2.1 time: 0.155290 Aug 03 19:14:06.370032 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 385/766] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:14:06 2022] GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:14:07.390673 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-c5d0bd67-acc0-4188-81e9-6425ba20007b tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:14:07.391279 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-c5d0bd67-acc0-4188-81e9-6425ba20007b tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:14:07.397906 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c5d0bd67-acc0-4188-81e9-6425ba20007b tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:07.398443 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c5d0bd67-acc0-4188-81e9-6425ba20007b tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:07.400060 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c5d0bd67-acc0-4188-81e9-6425ba20007b tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:07.400494 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c5d0bd67-acc0-4188-81e9-6425ba20007b tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:07.405870 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=100 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:14:07.538270 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-c5d0bd67-acc0-4188-81e9-6425ba20007b tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd34c15ce88473f97d18a609bb73a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd9d65265de4d71862e10a916f0a578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:14:07.546155 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-c5d0bd67-acc0-4188-81e9-6425ba20007b tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] 10.222.0.77 "GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae" status: 200 len: 1502 microversion: 2.1 time: 0.159386 Aug 03 19:14:07.546730 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 382/767] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:14:07 2022] GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:14:07.625944 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [req-24fa5258-a7a9-4345-aebb-3fa76a89ede8 req-c6b1ae01-8c83-4421-8ee1-d23e04903d8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae", "name": "network-vif-deleted", "tag": "f4e90580-2d35-42fd-87bb-4e0cca41dbb7"}]} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:14:07.630894 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:14:07.636780 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-24fa5258-a7a9-4345-aebb-3fa76a89ede8 req-c6b1ae01-8c83-4421-8ee1-d23e04903d8e service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:07.640982 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-24fa5258-a7a9-4345-aebb-3fa76a89ede8 req-c6b1ae01-8c83-4421-8ee1-d23e04903d8e service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:07.647996 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.compute.server_external_events [req-24fa5258-a7a9-4345-aebb-3fa76a89ede8 req-c6b1ae01-8c83-4421-8ee1-d23e04903d8e service nova] Creating event network-vif-deleted:f4e90580-2d35-42fd-87bb-4e0cca41dbb7 for instance 3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae on hv-cinder-85202 Aug 03 19:14:07.653018 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [req-24fa5258-a7a9-4345-aebb-3fa76a89ede8 req-c6b1ae01-8c83-4421-8ee1-d23e04903d8e service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030893 Aug 03 19:14:07.653583 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 386/768] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 19:14:08.571596 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-f172aba9-68b9-431b-89a9-8dc2e5abe407 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:14:08.572157 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-f172aba9-68b9-431b-89a9-8dc2e5abe407 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:14:08.578701 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f172aba9-68b9-431b-89a9-8dc2e5abe407 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:08.579192 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f172aba9-68b9-431b-89a9-8dc2e5abe407 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:08.579950 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f172aba9-68b9-431b-89a9-8dc2e5abe407 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:08.580383 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f172aba9-68b9-431b-89a9-8dc2e5abe407 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:08.612760 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f172aba9-68b9-431b-89a9-8dc2e5abe407 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:08.613273 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f172aba9-68b9-431b-89a9-8dc2e5abe407 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:08.613728 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.objects.instance [None req-f172aba9-68b9-431b-89a9-8dc2e5abe407 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lazy-loading 'fault' on Instance uuid 3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae {{(pid=118302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:14:08.656231 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-f172aba9-68b9-431b-89a9-8dc2e5abe407 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd34c15ce88473f97d18a609bb73a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd9d65265de4d71862e10a916f0a578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:14:08.663748 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-f172aba9-68b9-431b-89a9-8dc2e5abe407 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] 10.222.0.77 "GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae" status: 200 len: 1303 microversion: 2.1 time: 0.097054 Aug 03 19:14:08.664377 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 383/769] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:14:08 2022] GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae => generated 1303 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:14:09.687263 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-e64bef18-8f64-4dd4-af5a-718d1f009142 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:14:09.687954 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-e64bef18-8f64-4dd4-af5a-718d1f009142 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:14:09.694274 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e64bef18-8f64-4dd4-af5a-718d1f009142 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:09.695637 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e64bef18-8f64-4dd4-af5a-718d1f009142 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:09.695637 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e64bef18-8f64-4dd4-af5a-718d1f009142 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:09.696305 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e64bef18-8f64-4dd4-af5a-718d1f009142 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:09.710547 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.wsgi [None req-e64bef18-8f64-4dd4-af5a-718d1f009142 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] HTTP exception thrown: Instance 3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae could not be found. Aug 03 19:14:09.712784 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-e64bef18-8f64-4dd4-af5a-718d1f009142 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Request method failure captured: Aug 03 19:14:09.712784 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: request: GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae HTTP/1.1 Aug 03 19:14:09.712784 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept: application/json Aug 03 19:14:09.712784 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept-Encoding: identity Aug 03 19:14:09.712784 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Connection: close Aug 03 19:14:09.712784 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Length: 0 Aug 03 19:14:09.712784 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Type: application/json Aug 03 19:14:09.712784 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Host: 10.222.0.77 Aug 03 19:14:09.712784 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Openstack-System-Scope: None Aug 03 19:14:09.712784 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: User-Agent: python-urllib3/1.26.11 Aug 03 19:14:09.712784 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Auth-Token: gAAAAABi6sjnPTSUDdUaXMyUBHVQKy80ycYuj15G6BvUB076rpbCtpWCankNLP3llsHNRzamY8EIv7k5CwRBibtWCvWwpobCrNN5SFfigzhk-fhcuDN7rNROBcm2wU49qGZ3DSWHIKRvXq75umT-LPXs0wgEftGwa-SebeNXJBtaFgNicoGdY94 Aug 03 19:14:09.712784 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Id: None Aug 03 19:14:09.712784 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Name: None Aug 03 19:14:09.712784 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Identity-Status: Confirmed Aug 03 19:14:09.712784 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Is-Admin-Project: True Aug 03 19:14:09.712784 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Id: default Aug 03 19:14:09.712784 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Name: Default Aug 03 19:14:09.712784 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Id: bbd9d65265de4d71862e10a916f0a578 Aug 03 19:14:09.712784 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Name: tempest-VolumesActionsTest-148320578 Aug 03 19:14:09.712784 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Role: reader,member Aug 03 19:14:09.712784 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Roles: reader,member Aug 03 19:14:09.714471 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_bbd9d65265de4d71862e10a916f0a578", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/bbd9d65265de4d71862e10a916f0a578"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/bbd9d65265de4d71862e10a916f0a578"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/bbd9d65265de4d71862e10a916f0a578"}]}] Aug 03 19:14:09.714471 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant: tempest-VolumesActionsTest-148320578 Aug 03 19:14:09.714471 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Id: bbd9d65265de4d71862e10a916f0a578 Aug 03 19:14:09.714471 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Name: tempest-VolumesActionsTest-148320578 Aug 03 19:14:09.714471 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User: tempest-VolumesActionsTest-148320578-project Aug 03 19:14:09.714471 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Id: default Aug 03 19:14:09.714471 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Name: Default Aug 03 19:14:09.714471 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Id: fdd34c15ce88473f97d18a609bb73a5a Aug 03 19:14:09.714471 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Name: tempest-VolumesActionsTest-148320578-project Aug 03 19:14:09.714471 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: method: > Aug 03 19:14:09.714471 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: exception: Instance 3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae could not be found. Aug 03 19:14:09.714471 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: action_args: {'id': '3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae'} Aug 03 19:14:09.715358 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:14:09.715358 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:14:09.715358 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:14:09.715358 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:14:09.715358 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:14:09.715358 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:14:09.715358 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:14:09.715358 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:14:09.715358 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:14:09.715358 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:14:09.715358 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae could not be found. Aug 03 19:14:09.715358 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:14:09.715358 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:14:09.715358 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:14:09.715358 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:14:09.715358 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:14:09.715358 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:14:09.715358 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:14:09.715358 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:14:09.715358 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:14:09.716730 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:14:09.716730 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:14:09.716730 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:14:09.716730 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:14:09.716730 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:14:09.716730 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:14:09.716730 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:14:09.716730 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae could not be found. Aug 03 19:14:09.716730 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:14:09.716730 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:14:09.716730 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:14:09.716730 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:14:09.716730 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:14:09.716730 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:14:09.716730 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:14:09.716730 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:14:09.716730 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae could not be found. Aug 03 19:14:09.716730 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:14:09.717914 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-e64bef18-8f64-4dd4-af5a-718d1f009142 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Returning 404 to user: Instance 3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae could not be found. {{(pid=118303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:14:09.717914 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-e64bef18-8f64-4dd4-af5a-718d1f009142 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] 10.222.0.77 "GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae" status: 404 len: 111 microversion: 2.1 time: 0.032903 Aug 03 19:14:09.717914 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 387/770] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:14:09 2022] GET /compute/v2.1/servers/3facf7ea-0aa4-49ad-b1ad-b478a9a8c4ae => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:14:09.775725 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-5220b6a3-009e-4e1b-8e43-000b8dcb46d8 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1039558234", "imageRef": "0b6be242-215e-4886-a0d2-b8d5f8ca623e", "flavorRef": "452", "networks": [{"uuid": "8854b9ff-67e9-4d05-8330-db1a088ab2d8"}]}} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:14:09.833008 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.network.neutron [None req-5220b6a3-009e-4e1b-8e43-000b8dcb46d8 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] validate_networks() for [('8854b9ff-67e9-4d05-8330-db1a088ab2d8', None, None, None, None, None)] {{(pid=118302) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 19:14:10.237055 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-5220b6a3-009e-4e1b-8e43-000b8dcb46d8 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Flavor limits 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 19:14:10.239242 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-5220b6a3-009e-4e1b-8e43-000b8dcb46d8 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Image limits 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 19:14:10.239242 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-5220b6a3-009e-4e1b-8e43-000b8dcb46d8 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Flavor pref 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 19:14:10.240006 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-5220b6a3-009e-4e1b-8e43-000b8dcb46d8 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Image pref 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 19:14:10.240783 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-5220b6a3-009e-4e1b-8e43-000b8dcb46d8 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 19:14:10.253822 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-5220b6a3-009e-4e1b-8e43-000b8dcb46d8 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:10.254378 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-5220b6a3-009e-4e1b-8e43-000b8dcb46d8 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:10.255592 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-5220b6a3-009e-4e1b-8e43-000b8dcb46d8 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:10.256032 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-5220b6a3-009e-4e1b-8e43-000b8dcb46d8 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:10.276794 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.quota [None req-5220b6a3-009e-4e1b-8e43-000b8dcb46d8 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Getting quotas for project bbd9d65265de4d71862e10a916f0a578. Resources: {'instances', 'cores', 'ram'} {{(pid=118302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:14:10.281162 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.quota [None req-5220b6a3-009e-4e1b-8e43-000b8dcb46d8 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Getting quotas for user fdd34c15ce88473f97d18a609bb73a5a and project bbd9d65265de4d71862e10a916f0a578. Resources: {'instances', 'cores', 'ram'} {{(pid=118302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:14:10.293929 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-5220b6a3-009e-4e1b-8e43-000b8dcb46d8 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Going to run 1 instances... {{(pid=118302) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 19:14:10.296241 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-5220b6a3-009e-4e1b-8e43-000b8dcb46d8 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 6293bb3c-6c89-4e4c-973b-422a00ca73b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0b6be242-215e-4886-a0d2-b8d5f8ca623e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 19:14:10.444685 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-5220b6a3-009e-4e1b-8e43-000b8dcb46d8 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.676956 Aug 03 19:14:10.445362 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 384/771] 10.222.0.77 () {60 vars in 1147 bytes} [Wed Aug 3 19:14:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 19:14:10.457127 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-8194316a-33c0-45e7-8b8e-7fe451edd51f tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:14:10.457741 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-8194316a-33c0-45e7-8b8e-7fe451edd51f tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 6293bb3c-6c89-4e4c-973b-422a00ca73b0] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:14:10.521838 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-8194316a-33c0-45e7-8b8e-7fe451edd51f tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd34c15ce88473f97d18a609bb73a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd9d65265de4d71862e10a916f0a578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:14:10.529310 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-8194316a-33c0-45e7-8b8e-7fe451edd51f tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] 10.222.0.77 "GET /compute/v2.1/servers/6293bb3c-6c89-4e4c-973b-422a00ca73b0" status: 200 len: 1214 microversion: 2.1 time: 0.076371 Aug 03 19:14:10.529892 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 388/772] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:14:10 2022] GET /compute/v2.1/servers/6293bb3c-6c89-4e4c-973b-422a00ca73b0 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:14:11.551446 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-4bee95d0-8ce6-4297-a0ef-aa6a36787f96 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:14:11.552099 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-4bee95d0-8ce6-4297-a0ef-aa6a36787f96 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 6293bb3c-6c89-4e4c-973b-422a00ca73b0] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:14:11.559374 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4bee95d0-8ce6-4297-a0ef-aa6a36787f96 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:11.559815 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4bee95d0-8ce6-4297-a0ef-aa6a36787f96 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:11.560592 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4bee95d0-8ce6-4297-a0ef-aa6a36787f96 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:11.561024 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4bee95d0-8ce6-4297-a0ef-aa6a36787f96 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:11.628088 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-4bee95d0-8ce6-4297-a0ef-aa6a36787f96 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd34c15ce88473f97d18a609bb73a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd9d65265de4d71862e10a916f0a578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:14:11.636465 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-4bee95d0-8ce6-4297-a0ef-aa6a36787f96 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] 10.222.0.77 "GET /compute/v2.1/servers/6293bb3c-6c89-4e4c-973b-422a00ca73b0" status: 200 len: 1218 microversion: 2.1 time: 0.089098 Aug 03 19:14:11.637037 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 385/773] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:14:11 2022] GET /compute/v2.1/servers/6293bb3c-6c89-4e4c-973b-422a00ca73b0 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:14:12.659684 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-9956d358-f826-4a02-bd4d-0515ee465da7 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:14:12.660785 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-9956d358-f826-4a02-bd4d-0515ee465da7 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 6293bb3c-6c89-4e4c-973b-422a00ca73b0] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:14:12.671726 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9956d358-f826-4a02-bd4d-0515ee465da7 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:12.672479 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9956d358-f826-4a02-bd4d-0515ee465da7 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:12.673430 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9956d358-f826-4a02-bd4d-0515ee465da7 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:12.673939 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-9956d358-f826-4a02-bd4d-0515ee465da7 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:12.746019 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-9956d358-f826-4a02-bd4d-0515ee465da7 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd34c15ce88473f97d18a609bb73a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd9d65265de4d71862e10a916f0a578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:14:12.754201 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-9956d358-f826-4a02-bd4d-0515ee465da7 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] 10.222.0.77 "GET /compute/v2.1/servers/6293bb3c-6c89-4e4c-973b-422a00ca73b0" status: 200 len: 1284 microversion: 2.1 time: 0.099663 Aug 03 19:14:12.754727 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 389/774] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:14:12 2022] GET /compute/v2.1/servers/6293bb3c-6c89-4e4c-973b-422a00ca73b0 => generated 1284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:14:13.781147 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-a5b7a0a8-3102-48e6-91dd-80a8763ddf3f tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:14:13.782174 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-a5b7a0a8-3102-48e6-91dd-80a8763ddf3f tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 6293bb3c-6c89-4e4c-973b-422a00ca73b0] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:14:13.793336 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a5b7a0a8-3102-48e6-91dd-80a8763ddf3f tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:13.797258 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a5b7a0a8-3102-48e6-91dd-80a8763ddf3f tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:13.797258 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a5b7a0a8-3102-48e6-91dd-80a8763ddf3f tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:13.797258 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a5b7a0a8-3102-48e6-91dd-80a8763ddf3f tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:13.942481 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-a5b7a0a8-3102-48e6-91dd-80a8763ddf3f tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd34c15ce88473f97d18a609bb73a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd9d65265de4d71862e10a916f0a578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:14:13.950247 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-a5b7a0a8-3102-48e6-91dd-80a8763ddf3f tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] 10.222.0.77 "GET /compute/v2.1/servers/6293bb3c-6c89-4e4c-973b-422a00ca73b0" status: 200 len: 1314 microversion: 2.1 time: 0.175603 Aug 03 19:14:13.950825 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 386/775] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:14:13 2022] GET /compute/v2.1/servers/6293bb3c-6c89-4e4c-973b-422a00ca73b0 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:14:14.228602 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [req-79ecbf49-80da-4e05-b98b-70fbab4ef5e9 req-d824f13f-45eb-43a7-8a74-55a0c38837f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6293bb3c-6c89-4e4c-973b-422a00ca73b0", "tag": "b97d4928-1ba2-4cf4-8e7b-61bb41b55e2e"}]} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:14:14.241563 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-79ecbf49-80da-4e05-b98b-70fbab4ef5e9 req-d824f13f-45eb-43a7-8a74-55a0c38837f3 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:14.242284 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-79ecbf49-80da-4e05-b98b-70fbab4ef5e9 req-d824f13f-45eb-43a7-8a74-55a0c38837f3 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:14.256598 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.compute.server_external_events [req-79ecbf49-80da-4e05-b98b-70fbab4ef5e9 req-d824f13f-45eb-43a7-8a74-55a0c38837f3 service nova] Creating event network-changed:b97d4928-1ba2-4cf4-8e7b-61bb41b55e2e for instance 6293bb3c-6c89-4e4c-973b-422a00ca73b0 on hv-cinder-85202 Aug 03 19:14:14.262039 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [req-79ecbf49-80da-4e05-b98b-70fbab4ef5e9 req-d824f13f-45eb-43a7-8a74-55a0c38837f3 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038081 Aug 03 19:14:14.263048 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 390/776] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:14:14.982639 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-328f0e2e-c378-44fb-a8c7-43d914160a74 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:14:14.983339 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-328f0e2e-c378-44fb-a8c7-43d914160a74 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 6293bb3c-6c89-4e4c-973b-422a00ca73b0] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:14:14.990129 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-328f0e2e-c378-44fb-a8c7-43d914160a74 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:14.990580 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-328f0e2e-c378-44fb-a8c7-43d914160a74 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:14.991403 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-328f0e2e-c378-44fb-a8c7-43d914160a74 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:14.991836 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-328f0e2e-c378-44fb-a8c7-43d914160a74 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:15.146705 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-328f0e2e-c378-44fb-a8c7-43d914160a74 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd34c15ce88473f97d18a609bb73a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd9d65265de4d71862e10a916f0a578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:14:15.156596 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-328f0e2e-c378-44fb-a8c7-43d914160a74 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] 10.222.0.77 "GET /compute/v2.1/servers/6293bb3c-6c89-4e4c-973b-422a00ca73b0" status: 200 len: 1314 microversion: 2.1 time: 0.178081 Aug 03 19:14:15.157368 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 387/777] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:14:14 2022] GET /compute/v2.1/servers/6293bb3c-6c89-4e4c-973b-422a00ca73b0 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:14:16.179123 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-49a48249-9380-49c8-a7c6-a7c069583e35 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:14:16.179905 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-49a48249-9380-49c8-a7c6-a7c069583e35 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 6293bb3c-6c89-4e4c-973b-422a00ca73b0] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:14:16.187387 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-49a48249-9380-49c8-a7c6-a7c069583e35 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:16.187833 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-49a48249-9380-49c8-a7c6-a7c069583e35 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:16.188606 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-49a48249-9380-49c8-a7c6-a7c069583e35 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:16.189031 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-49a48249-9380-49c8-a7c6-a7c069583e35 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:16.332425 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-49a48249-9380-49c8-a7c6-a7c069583e35 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd34c15ce88473f97d18a609bb73a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd9d65265de4d71862e10a916f0a578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:14:16.340506 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-49a48249-9380-49c8-a7c6-a7c069583e35 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] 10.222.0.77 "GET /compute/v2.1/servers/6293bb3c-6c89-4e4c-973b-422a00ca73b0" status: 200 len: 1314 microversion: 2.1 time: 0.166136 Aug 03 19:14:16.341084 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 391/778] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:14:16 2022] GET /compute/v2.1/servers/6293bb3c-6c89-4e4c-973b-422a00ca73b0 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:14:17.361550 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-a3d66d6d-1c29-4577-9e78-f08cf7ee4ec4 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:14:17.362187 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-a3d66d6d-1c29-4577-9e78-f08cf7ee4ec4 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 6293bb3c-6c89-4e4c-973b-422a00ca73b0] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:14:17.370143 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a3d66d6d-1c29-4577-9e78-f08cf7ee4ec4 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:17.370596 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a3d66d6d-1c29-4577-9e78-f08cf7ee4ec4 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:17.371404 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a3d66d6d-1c29-4577-9e78-f08cf7ee4ec4 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:17.371841 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a3d66d6d-1c29-4577-9e78-f08cf7ee4ec4 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:17.514328 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-a3d66d6d-1c29-4577-9e78-f08cf7ee4ec4 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd34c15ce88473f97d18a609bb73a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd9d65265de4d71862e10a916f0a578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:14:17.522464 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-a3d66d6d-1c29-4577-9e78-f08cf7ee4ec4 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] 10.222.0.77 "GET /compute/v2.1/servers/6293bb3c-6c89-4e4c-973b-422a00ca73b0" status: 200 len: 1314 microversion: 2.1 time: 0.164238 Aug 03 19:14:17.523050 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 388/779] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:14:17 2022] GET /compute/v2.1/servers/6293bb3c-6c89-4e4c-973b-422a00ca73b0 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:14:18.544275 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-ce64c72b-e8eb-4f09-9e72-7c15a04525b7 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:14:18.545185 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-ce64c72b-e8eb-4f09-9e72-7c15a04525b7 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 6293bb3c-6c89-4e4c-973b-422a00ca73b0] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:14:18.553392 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ce64c72b-e8eb-4f09-9e72-7c15a04525b7 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:18.553850 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ce64c72b-e8eb-4f09-9e72-7c15a04525b7 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:18.554650 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ce64c72b-e8eb-4f09-9e72-7c15a04525b7 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:18.555485 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ce64c72b-e8eb-4f09-9e72-7c15a04525b7 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:18.696965 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-ce64c72b-e8eb-4f09-9e72-7c15a04525b7 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd34c15ce88473f97d18a609bb73a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd9d65265de4d71862e10a916f0a578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:14:18.704844 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-ce64c72b-e8eb-4f09-9e72-7c15a04525b7 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] 10.222.0.77 "GET /compute/v2.1/servers/6293bb3c-6c89-4e4c-973b-422a00ca73b0" status: 200 len: 1314 microversion: 2.1 time: 0.165435 Aug 03 19:14:18.705423 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 392/780] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:14:18 2022] GET /compute/v2.1/servers/6293bb3c-6c89-4e4c-973b-422a00ca73b0 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:14:19.726071 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-d5de1f1f-635c-4528-8d5d-cc80b7ec9a20 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:14:19.726633 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-d5de1f1f-635c-4528-8d5d-cc80b7ec9a20 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 6293bb3c-6c89-4e4c-973b-422a00ca73b0] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:14:19.733818 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d5de1f1f-635c-4528-8d5d-cc80b7ec9a20 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:19.734288 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d5de1f1f-635c-4528-8d5d-cc80b7ec9a20 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:19.735151 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d5de1f1f-635c-4528-8d5d-cc80b7ec9a20 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:19.735594 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d5de1f1f-635c-4528-8d5d-cc80b7ec9a20 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:19.880833 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-d5de1f1f-635c-4528-8d5d-cc80b7ec9a20 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd34c15ce88473f97d18a609bb73a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd9d65265de4d71862e10a916f0a578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:14:19.888743 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-d5de1f1f-635c-4528-8d5d-cc80b7ec9a20 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] 10.222.0.77 "GET /compute/v2.1/servers/6293bb3c-6c89-4e4c-973b-422a00ca73b0" status: 200 len: 1314 microversion: 2.1 time: 0.166656 Aug 03 19:14:19.889341 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 389/781] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:14:19 2022] GET /compute/v2.1/servers/6293bb3c-6c89-4e4c-973b-422a00ca73b0 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:14:20.482615 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [req-1a94cea3-eda0-41dc-b399-ac408bad035c req-e32c6454-9a0e-47bf-b2f3-3e07d3d95fcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6293bb3c-6c89-4e4c-973b-422a00ca73b0", "name": "network-vif-plugged", "status": "completed", "tag": "b97d4928-1ba2-4cf4-8e7b-61bb41b55e2e"}]} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:14:20.492637 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-1a94cea3-eda0-41dc-b399-ac408bad035c req-e32c6454-9a0e-47bf-b2f3-3e07d3d95fcb service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:20.493393 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-1a94cea3-eda0-41dc-b399-ac408bad035c req-e32c6454-9a0e-47bf-b2f3-3e07d3d95fcb service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:20.505173 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.compute.server_external_events [req-1a94cea3-eda0-41dc-b399-ac408bad035c req-e32c6454-9a0e-47bf-b2f3-3e07d3d95fcb service nova] Creating event network-vif-plugged:b97d4928-1ba2-4cf4-8e7b-61bb41b55e2e for instance 6293bb3c-6c89-4e4c-973b-422a00ca73b0 on hv-cinder-85202 Aug 03 19:14:20.511997 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [req-1a94cea3-eda0-41dc-b399-ac408bad035c req-e32c6454-9a0e-47bf-b2f3-3e07d3d95fcb service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033029 Aug 03 19:14:20.512690 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 393/782] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:14:20.913921 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-112a6105-549f-4c2b-bd2d-61c5c8d20714 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:14:20.915117 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-112a6105-549f-4c2b-bd2d-61c5c8d20714 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 6293bb3c-6c89-4e4c-973b-422a00ca73b0] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:14:20.918121 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell0:SELECT=2 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:14:20.919474 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell0:SELECT=6 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:14:20.927521 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-112a6105-549f-4c2b-bd2d-61c5c8d20714 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:20.945014 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-112a6105-549f-4c2b-bd2d-61c5c8d20714 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:20.945014 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-112a6105-549f-4c2b-bd2d-61c5c8d20714 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:20.945014 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-112a6105-549f-4c2b-bd2d-61c5c8d20714 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:21.101080 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-112a6105-549f-4c2b-bd2d-61c5c8d20714 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd34c15ce88473f97d18a609bb73a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd9d65265de4d71862e10a916f0a578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:14:21.106604 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-112a6105-549f-4c2b-bd2d-61c5c8d20714 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] 10.222.0.77 "GET /compute/v2.1/servers/6293bb3c-6c89-4e4c-973b-422a00ca73b0" status: 200 len: 1314 microversion: 2.1 time: 0.199592 Aug 03 19:14:21.107240 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 390/783] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:14:20 2022] GET /compute/v2.1/servers/6293bb3c-6c89-4e4c-973b-422a00ca73b0 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:14:22.124999 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell0:SELECT=2 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:14:22.129566 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-a6c91464-586c-461e-b9bb-edca2de9540e tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:14:22.130308 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-a6c91464-586c-461e-b9bb-edca2de9540e tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 6293bb3c-6c89-4e4c-973b-422a00ca73b0] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:14:22.137402 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a6c91464-586c-461e-b9bb-edca2de9540e tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:22.137851 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a6c91464-586c-461e-b9bb-edca2de9540e tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:22.138623 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a6c91464-586c-461e-b9bb-edca2de9540e tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:22.139092 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a6c91464-586c-461e-b9bb-edca2de9540e tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:22.275554 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-a6c91464-586c-461e-b9bb-edca2de9540e tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd34c15ce88473f97d18a609bb73a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd9d65265de4d71862e10a916f0a578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:14:22.283995 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-a6c91464-586c-461e-b9bb-edca2de9540e tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] 10.222.0.77 "GET /compute/v2.1/servers/6293bb3c-6c89-4e4c-973b-422a00ca73b0" status: 200 len: 1314 microversion: 2.1 time: 0.159914 Aug 03 19:14:22.284668 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 394/784] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:14:22 2022] GET /compute/v2.1/servers/6293bb3c-6c89-4e4c-973b-422a00ca73b0 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:14:23.306391 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-db93747c-d582-4a07-bc6b-776ac4018f65 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:14:23.307092 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-db93747c-d582-4a07-bc6b-776ac4018f65 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 6293bb3c-6c89-4e4c-973b-422a00ca73b0] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:14:23.314154 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-db93747c-d582-4a07-bc6b-776ac4018f65 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:23.314593 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-db93747c-d582-4a07-bc6b-776ac4018f65 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:23.315388 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-db93747c-d582-4a07-bc6b-776ac4018f65 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:23.315822 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-db93747c-d582-4a07-bc6b-776ac4018f65 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:23.453980 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-db93747c-d582-4a07-bc6b-776ac4018f65 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd34c15ce88473f97d18a609bb73a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd9d65265de4d71862e10a916f0a578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:14:23.462115 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-db93747c-d582-4a07-bc6b-776ac4018f65 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] 10.222.0.77 "GET /compute/v2.1/servers/6293bb3c-6c89-4e4c-973b-422a00ca73b0" status: 200 len: 1496 microversion: 2.1 time: 0.159666 Aug 03 19:14:23.463193 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 391/785] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:14:23 2022] GET /compute/v2.1/servers/6293bb3c-6c89-4e4c-973b-422a00ca73b0 => generated 1496 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:14:24.811984 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-92cd37df-d006-4aa5-880b-e50392a1e76a tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:14:24.812578 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-92cd37df-d006-4aa5-880b-e50392a1e76a tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 6293bb3c-6c89-4e4c-973b-422a00ca73b0] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:14:24.819251 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-92cd37df-d006-4aa5-880b-e50392a1e76a tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:24.819762 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-92cd37df-d006-4aa5-880b-e50392a1e76a tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:24.820538 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-92cd37df-d006-4aa5-880b-e50392a1e76a tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:24.821643 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-92cd37df-d006-4aa5-880b-e50392a1e76a tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:24.847595 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-92cd37df-d006-4aa5-880b-e50392a1e76a tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 6293bb3c-6c89-4e4c-973b-422a00ca73b0] Going to try to terminate instance {{(pid=118303) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 19:14:25.522605 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-92cd37df-d006-4aa5-880b-e50392a1e76a tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] 10.222.0.77 "DELETE /compute/v2.1/servers/6293bb3c-6c89-4e4c-973b-422a00ca73b0" status: 204 len: 0 microversion: 2.1 time: 0.714071 Aug 03 19:14:25.523239 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 395/786] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 3 19:14:24 2022] DELETE /compute/v2.1/servers/6293bb3c-6c89-4e4c-973b-422a00ca73b0 => generated 0 bytes in 716 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 19:14:25.532244 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-adbf9f43-9e15-4d39-b1c2-623473aca404 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:14:25.532910 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-adbf9f43-9e15-4d39-b1c2-623473aca404 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 6293bb3c-6c89-4e4c-973b-422a00ca73b0] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:14:25.540968 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-adbf9f43-9e15-4d39-b1c2-623473aca404 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:25.543049 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-adbf9f43-9e15-4d39-b1c2-623473aca404 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:25.543049 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-adbf9f43-9e15-4d39-b1c2-623473aca404 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:25.543049 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-adbf9f43-9e15-4d39-b1c2-623473aca404 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:25.676974 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-adbf9f43-9e15-4d39-b1c2-623473aca404 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd34c15ce88473f97d18a609bb73a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd9d65265de4d71862e10a916f0a578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:14:25.685292 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-adbf9f43-9e15-4d39-b1c2-623473aca404 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] 10.222.0.77 "GET /compute/v2.1/servers/6293bb3c-6c89-4e4c-973b-422a00ca73b0" status: 200 len: 1502 microversion: 2.1 time: 0.157048 Aug 03 19:14:25.685943 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 392/787] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:14:25 2022] GET /compute/v2.1/servers/6293bb3c-6c89-4e4c-973b-422a00ca73b0 => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:14:26.707035 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-a1357276-69e3-41b9-ac02-e30840a6c985 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:14:26.707639 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-a1357276-69e3-41b9-ac02-e30840a6c985 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 6293bb3c-6c89-4e4c-973b-422a00ca73b0] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:14:26.715272 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a1357276-69e3-41b9-ac02-e30840a6c985 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:26.715724 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a1357276-69e3-41b9-ac02-e30840a6c985 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:26.716487 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a1357276-69e3-41b9-ac02-e30840a6c985 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:26.716922 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a1357276-69e3-41b9-ac02-e30840a6c985 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:26.721317 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:14:26.861569 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-a1357276-69e3-41b9-ac02-e30840a6c985 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd34c15ce88473f97d18a609bb73a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd9d65265de4d71862e10a916f0a578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:14:26.875843 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-a1357276-69e3-41b9-ac02-e30840a6c985 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] 10.222.0.77 "GET /compute/v2.1/servers/6293bb3c-6c89-4e4c-973b-422a00ca73b0" status: 200 len: 1502 microversion: 2.1 time: 0.173005 Aug 03 19:14:26.876900 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 396/788] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:14:26 2022] GET /compute/v2.1/servers/6293bb3c-6c89-4e4c-973b-422a00ca73b0 => generated 1502 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:14:27.824920 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-f9c0cd89-4dd6-42af-9ad2-3fd9d32e5615 req-b8de2dab-f011-4926-ba69-902ff2b6616d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6293bb3c-6c89-4e4c-973b-422a00ca73b0", "name": "network-vif-deleted", "tag": "b97d4928-1ba2-4cf4-8e7b-61bb41b55e2e"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:14:27.830545 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:14:27.835955 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-f9c0cd89-4dd6-42af-9ad2-3fd9d32e5615 req-b8de2dab-f011-4926-ba69-902ff2b6616d service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:27.839563 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-f9c0cd89-4dd6-42af-9ad2-3fd9d32e5615 req-b8de2dab-f011-4926-ba69-902ff2b6616d service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:27.848122 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-f9c0cd89-4dd6-42af-9ad2-3fd9d32e5615 req-b8de2dab-f011-4926-ba69-902ff2b6616d service nova] Creating event network-vif-deleted:b97d4928-1ba2-4cf4-8e7b-61bb41b55e2e for instance 6293bb3c-6c89-4e4c-973b-422a00ca73b0 on hv-cinder-85202 Aug 03 19:14:27.853862 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-f9c0cd89-4dd6-42af-9ad2-3fd9d32e5615 req-b8de2dab-f011-4926-ba69-902ff2b6616d service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032678 Aug 03 19:14:27.854541 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 393/789] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:14:27.898482 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-0598c23e-d7a2-4dc7-8e90-573c11202bb3 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:14:27.899386 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-0598c23e-d7a2-4dc7-8e90-573c11202bb3 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 6293bb3c-6c89-4e4c-973b-422a00ca73b0] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:14:27.906392 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0598c23e-d7a2-4dc7-8e90-573c11202bb3 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:27.906841 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0598c23e-d7a2-4dc7-8e90-573c11202bb3 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:27.907643 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0598c23e-d7a2-4dc7-8e90-573c11202bb3 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:27.908227 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0598c23e-d7a2-4dc7-8e90-573c11202bb3 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:27.980577 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-0598c23e-d7a2-4dc7-8e90-573c11202bb3 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd34c15ce88473f97d18a609bb73a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd9d65265de4d71862e10a916f0a578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:14:27.988191 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-0598c23e-d7a2-4dc7-8e90-573c11202bb3 tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] 10.222.0.77 "GET /compute/v2.1/servers/6293bb3c-6c89-4e4c-973b-422a00ca73b0" status: 200 len: 1460 microversion: 2.1 time: 0.094314 Aug 03 19:14:27.988789 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 397/790] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:14:27 2022] GET /compute/v2.1/servers/6293bb3c-6c89-4e4c-973b-422a00ca73b0 => generated 1460 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:14:29.012283 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-78b74a27-8d05-4144-b9db-4d4e3673f4ec tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:14:29.012982 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-78b74a27-8d05-4144-b9db-4d4e3673f4ec tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] [instance: 6293bb3c-6c89-4e4c-973b-422a00ca73b0] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:14:29.019817 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-78b74a27-8d05-4144-b9db-4d4e3673f4ec tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:29.020268 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-78b74a27-8d05-4144-b9db-4d4e3673f4ec tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:29.034911 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-78b74a27-8d05-4144-b9db-4d4e3673f4ec tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:14:29.034911 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-78b74a27-8d05-4144-b9db-4d4e3673f4ec tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:14:29.037198 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.wsgi [None req-78b74a27-8d05-4144-b9db-4d4e3673f4ec tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] HTTP exception thrown: Instance 6293bb3c-6c89-4e4c-973b-422a00ca73b0 could not be found. Aug 03 19:14:29.038869 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-78b74a27-8d05-4144-b9db-4d4e3673f4ec tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Request method failure captured: Aug 03 19:14:29.038869 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: request: GET /compute/v2.1/servers/6293bb3c-6c89-4e4c-973b-422a00ca73b0 HTTP/1.1 Aug 03 19:14:29.038869 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept: application/json Aug 03 19:14:29.038869 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept-Encoding: identity Aug 03 19:14:29.038869 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Connection: close Aug 03 19:14:29.038869 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Length: 0 Aug 03 19:14:29.038869 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Type: application/json Aug 03 19:14:29.038869 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Host: 10.222.0.77 Aug 03 19:14:29.038869 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Openstack-System-Scope: None Aug 03 19:14:29.038869 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: User-Agent: python-urllib3/1.26.11 Aug 03 19:14:29.038869 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Auth-Token: gAAAAABi6sjnPTSUDdUaXMyUBHVQKy80ycYuj15G6BvUB076rpbCtpWCankNLP3llsHNRzamY8EIv7k5CwRBibtWCvWwpobCrNN5SFfigzhk-fhcuDN7rNROBcm2wU49qGZ3DSWHIKRvXq75umT-LPXs0wgEftGwa-SebeNXJBtaFgNicoGdY94 Aug 03 19:14:29.038869 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Id: None Aug 03 19:14:29.038869 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Name: None Aug 03 19:14:29.038869 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Identity-Status: Confirmed Aug 03 19:14:29.038869 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Is-Admin-Project: True Aug 03 19:14:29.038869 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Id: default Aug 03 19:14:29.038869 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Name: Default Aug 03 19:14:29.038869 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Id: bbd9d65265de4d71862e10a916f0a578 Aug 03 19:14:29.038869 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Name: tempest-VolumesActionsTest-148320578 Aug 03 19:14:29.038869 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Role: reader,member Aug 03 19:14:29.038869 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Roles: reader,member Aug 03 19:14:29.040631 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_bbd9d65265de4d71862e10a916f0a578", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/bbd9d65265de4d71862e10a916f0a578"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/bbd9d65265de4d71862e10a916f0a578"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/bbd9d65265de4d71862e10a916f0a578"}]}] Aug 03 19:14:29.040631 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant: tempest-VolumesActionsTest-148320578 Aug 03 19:14:29.040631 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Id: bbd9d65265de4d71862e10a916f0a578 Aug 03 19:14:29.040631 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Name: tempest-VolumesActionsTest-148320578 Aug 03 19:14:29.040631 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User: tempest-VolumesActionsTest-148320578-project Aug 03 19:14:29.040631 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Id: default Aug 03 19:14:29.040631 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Name: Default Aug 03 19:14:29.040631 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Id: fdd34c15ce88473f97d18a609bb73a5a Aug 03 19:14:29.040631 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Name: tempest-VolumesActionsTest-148320578-project Aug 03 19:14:29.040631 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: method: > Aug 03 19:14:29.040631 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: exception: Instance 6293bb3c-6c89-4e4c-973b-422a00ca73b0 could not be found. Aug 03 19:14:29.040631 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: action_args: {'id': '6293bb3c-6c89-4e4c-973b-422a00ca73b0'} Aug 03 19:14:29.042200 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:14:29.042200 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:14:29.042200 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:14:29.042200 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:14:29.042200 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:14:29.042200 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:14:29.042200 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:14:29.042200 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:14:29.042200 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:14:29.042200 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:14:29.042200 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6293bb3c-6c89-4e4c-973b-422a00ca73b0 could not be found. Aug 03 19:14:29.042200 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:14:29.042200 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:14:29.042200 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:14:29.042200 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:14:29.042200 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:14:29.042200 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:14:29.042200 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:14:29.042200 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:14:29.042200 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:14:29.044909 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:14:29.044909 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:14:29.044909 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:14:29.044909 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:14:29.044909 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:14:29.044909 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:14:29.044909 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:14:29.044909 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6293bb3c-6c89-4e4c-973b-422a00ca73b0 could not be found. Aug 03 19:14:29.044909 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:14:29.044909 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:14:29.044909 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:14:29.044909 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:14:29.044909 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:14:29.044909 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:14:29.044909 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:14:29.044909 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:14:29.044909 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6293bb3c-6c89-4e4c-973b-422a00ca73b0 could not be found. Aug 03 19:14:29.044909 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:14:29.046346 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-78b74a27-8d05-4144-b9db-4d4e3673f4ec tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] Returning 404 to user: Instance 6293bb3c-6c89-4e4c-973b-422a00ca73b0 could not be found. {{(pid=118302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:14:29.046346 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-78b74a27-8d05-4144-b9db-4d4e3673f4ec tempest-VolumesActionsTest-148320578 tempest-VolumesActionsTest-148320578-project] 10.222.0.77 "GET /compute/v2.1/servers/6293bb3c-6c89-4e4c-973b-422a00ca73b0" status: 404 len: 111 microversion: 2.1 time: 0.034277 Aug 03 19:14:29.046346 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 394/791] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:14:29 2022] GET /compute/v2.1/servers/6293bb3c-6c89-4e4c-973b-422a00ca73b0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:14:46.518001 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 19:14:46.518854 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Wed Aug 3 19:14:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 19:15:04.322304 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-a3221801-7ade-4f32-b35c-1647e9e3846d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:15:04.323031 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-a3221801-7ade-4f32-b35c-1647e9e3846d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:15:04.331733 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:15:04.331733 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=10 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:15:04.331733 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a3221801-7ade-4f32-b35c-1647e9e3846d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:04.332114 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a3221801-7ade-4f32-b35c-1647e9e3846d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:04.332546 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a3221801-7ade-4f32-b35c-1647e9e3846d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:04.332976 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a3221801-7ade-4f32-b35c-1647e9e3846d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:04.364100 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-a3221801-7ade-4f32-b35c-1647e9e3846d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a/os-volume_attachments/2cd1a5c5-0872-444a-bc60-45b37f67b6da" status: 200 len: 194 microversion: 2.20 time: 0.045898 Aug 03 19:15:04.364694 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 398/792] 10.222.0.77 () {60 vars in 1454 bytes} [Wed Aug 3 19:15:04 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a/os-volume_attachments/2cd1a5c5-0872-444a-bc60-45b37f67b6da => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 19:15:04.435366 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-3c2771bf-8873-4e6d-86da-8029e59cb6d9 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:15:04.435921 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-3c2771bf-8873-4e6d-86da-8029e59cb6d9 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:15:04.438569 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=66 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:15:04.443589 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3c2771bf-8873-4e6d-86da-8029e59cb6d9 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:04.444043 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3c2771bf-8873-4e6d-86da-8029e59cb6d9 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:04.444810 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3c2771bf-8873-4e6d-86da-8029e59cb6d9 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:04.445326 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3c2771bf-8873-4e6d-86da-8029e59cb6d9 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:04.529992 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.objects.instance [None req-3c2771bf-8873-4e6d-86da-8029e59cb6d9 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lazy-loading 'services' on Instance uuid 2e21c8ef-c172-41cd-806e-f69f81116b6a {{(pid=118302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:15:04.785369 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-3c2771bf-8873-4e6d-86da-8029e59cb6d9 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "DELETE /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a/os-volume_attachments/2cd1a5c5-0872-444a-bc60-45b37f67b6da" status: 202 len: 0 microversion: 2.20 time: 0.353964 Aug 03 19:15:04.785840 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 395/793] 10.222.0.77 () {60 vars in 1457 bytes} [Wed Aug 3 19:15:04 2022] DELETE /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a/os-volume_attachments/2cd1a5c5-0872-444a-bc60-45b37f67b6da => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 19:15:04.794633 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-bd640c1e-8550-448a-a488-dd6ab5ff2c7e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:15:04.797121 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-bd640c1e-8550-448a-a488-dd6ab5ff2c7e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:15:04.804100 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-bd640c1e-8550-448a-a488-dd6ab5ff2c7e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:04.804551 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-bd640c1e-8550-448a-a488-dd6ab5ff2c7e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:04.805325 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-bd640c1e-8550-448a-a488-dd6ab5ff2c7e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:04.805777 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-bd640c1e-8550-448a-a488-dd6ab5ff2c7e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:04.835838 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-bd640c1e-8550-448a-a488-dd6ab5ff2c7e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045547 Aug 03 19:15:04.836384 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 399/794] 10.222.0.77 () {60 vars in 1343 bytes} [Wed Aug 3 19:15:04 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 19:15:05.850203 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-36472d1b-7ed1-4963-93ae-7ce9f56c54e2 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:15:05.852510 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-36472d1b-7ed1-4963-93ae-7ce9f56c54e2 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:15:05.860002 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-36472d1b-7ed1-4963-93ae-7ce9f56c54e2 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:05.860452 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-36472d1b-7ed1-4963-93ae-7ce9f56c54e2 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:05.861225 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-36472d1b-7ed1-4963-93ae-7ce9f56c54e2 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:05.861652 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-36472d1b-7ed1-4963-93ae-7ce9f56c54e2 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:05.893374 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-36472d1b-7ed1-4963-93ae-7ce9f56c54e2 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047965 Aug 03 19:15:05.893989 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 396/795] 10.222.0.77 () {60 vars in 1343 bytes} [Wed Aug 3 19:15:05 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 19:15:06.907196 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-cc10529d-c36a-4269-b48f-556ad9caf39d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:15:06.909318 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-cc10529d-c36a-4269-b48f-556ad9caf39d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:15:06.916176 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cc10529d-c36a-4269-b48f-556ad9caf39d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:06.916620 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cc10529d-c36a-4269-b48f-556ad9caf39d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:06.917443 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cc10529d-c36a-4269-b48f-556ad9caf39d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:06.917869 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cc10529d-c36a-4269-b48f-556ad9caf39d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:06.947517 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-cc10529d-c36a-4269-b48f-556ad9caf39d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045571 Aug 03 19:15:06.948102 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 400/796] 10.222.0.77 () {60 vars in 1343 bytes} [Wed Aug 3 19:15:06 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:15:07.011372 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-7ab33ad6-e347-4c3a-b918-603cc925da4f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:15:07.011906 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-7ab33ad6-e347-4c3a-b918-603cc925da4f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:15:07.018510 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7ab33ad6-e347-4c3a-b918-603cc925da4f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:07.018988 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7ab33ad6-e347-4c3a-b918-603cc925da4f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:07.019763 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7ab33ad6-e347-4c3a-b918-603cc925da4f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:07.020202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7ab33ad6-e347-4c3a-b918-603cc925da4f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:07.049588 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-7ab33ad6-e347-4c3a-b918-603cc925da4f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Going to try to terminate instance {{(pid=118302) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 19:15:07.329056 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-7ab33ad6-e347-4c3a-b918-603cc925da4f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "DELETE /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 204 len: 0 microversion: 2.20 time: 0.321252 Aug 03 19:15:07.329882 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 397/797] 10.222.0.77 () {60 vars in 1280 bytes} [Wed Aug 3 19:15:07 2022] DELETE /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 19:15:07.338116 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-4eb2ffd6-bce9-4787-9d8d-d5c2235012a5 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:15:07.338724 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-4eb2ffd6-bce9-4787-9d8d-d5c2235012a5 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:15:07.345056 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4eb2ffd6-bce9-4787-9d8d-d5c2235012a5 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:07.345505 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4eb2ffd6-bce9-4787-9d8d-d5c2235012a5 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:07.346276 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4eb2ffd6-bce9-4787-9d8d-d5c2235012a5 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:07.346733 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4eb2ffd6-bce9-4787-9d8d-d5c2235012a5 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:07.482046 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-4eb2ffd6-bce9-4787-9d8d-d5c2235012a5 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:07.490693 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-4eb2ffd6-bce9-4787-9d8d-d5c2235012a5 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:07.492372 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-4eb2ffd6-bce9-4787-9d8d-d5c2235012a5 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:07.493526 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-4eb2ffd6-bce9-4787-9d8d-d5c2235012a5 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1721 microversion: 2.20 time: 0.159368 Aug 03 19:15:07.494120 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 401/798] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:15:07 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:15:08.518347 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-bed433da-bd33-4bc3-b5bb-05a3cc551e79 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:15:08.519024 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-bed433da-bd33-4bc3-b5bb-05a3cc551e79 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:15:08.526003 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-bed433da-bd33-4bc3-b5bb-05a3cc551e79 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:08.526391 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-bed433da-bd33-4bc3-b5bb-05a3cc551e79 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:08.527338 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-bed433da-bd33-4bc3-b5bb-05a3cc551e79 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:08.527633 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-bed433da-bd33-4bc3-b5bb-05a3cc551e79 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:08.674690 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-bed433da-bd33-4bc3-b5bb-05a3cc551e79 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:08.684025 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-bed433da-bd33-4bc3-b5bb-05a3cc551e79 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:08.685778 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-bed433da-bd33-4bc3-b5bb-05a3cc551e79 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:08.687701 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-bed433da-bd33-4bc3-b5bb-05a3cc551e79 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1721 microversion: 2.20 time: 0.174514 Aug 03 19:15:08.688628 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 398/799] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:15:08 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:15:09.711609 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-a226e6d2-977a-49c2-be47-d2aeb5d0262b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:15:09.712229 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-a226e6d2-977a-49c2-be47-d2aeb5d0262b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:15:09.719033 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a226e6d2-977a-49c2-be47-d2aeb5d0262b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:09.719491 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a226e6d2-977a-49c2-be47-d2aeb5d0262b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:09.720275 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a226e6d2-977a-49c2-be47-d2aeb5d0262b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:09.720743 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a226e6d2-977a-49c2-be47-d2aeb5d0262b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:10.122033 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-a226e6d2-977a-49c2-be47-d2aeb5d0262b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:10.129995 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-a226e6d2-977a-49c2-be47-d2aeb5d0262b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:10.131636 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-a226e6d2-977a-49c2-be47-d2aeb5d0262b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:10.132870 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-a226e6d2-977a-49c2-be47-d2aeb5d0262b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1721 microversion: 2.20 time: 0.425723 Aug 03 19:15:10.133511 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 402/800] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:15:09 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1721 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:15:10.429598 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-b62225e8-60bb-487c-96f7-ecb3dd929a7a req-041c572d-9de9-4f8c-9979-91b56c8caa00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e21c8ef-c172-41cd-806e-f69f81116b6a", "name": "network-vif-deleted", "tag": "5bac2969-4e88-4008-93e1-3408ccc91cbb"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:15:10.440314 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-b62225e8-60bb-487c-96f7-ecb3dd929a7a req-041c572d-9de9-4f8c-9979-91b56c8caa00 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:10.440774 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-b62225e8-60bb-487c-96f7-ecb3dd929a7a req-041c572d-9de9-4f8c-9979-91b56c8caa00 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:10.452711 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-b62225e8-60bb-487c-96f7-ecb3dd929a7a req-041c572d-9de9-4f8c-9979-91b56c8caa00 service nova] Creating event network-vif-deleted:5bac2969-4e88-4008-93e1-3408ccc91cbb for instance 2e21c8ef-c172-41cd-806e-f69f81116b6a on hv-cinder-85202 Aug 03 19:15:10.457676 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-b62225e8-60bb-487c-96f7-ecb3dd929a7a req-041c572d-9de9-4f8c-9979-91b56c8caa00 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031714 Aug 03 19:15:10.458273 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 399/801] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:15:11.157080 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-399e10ec-86ed-4706-96bc-e8666d0be750 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:15:11.157804 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-399e10ec-86ed-4706-96bc-e8666d0be750 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:15:11.164710 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-399e10ec-86ed-4706-96bc-e8666d0be750 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:11.165153 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-399e10ec-86ed-4706-96bc-e8666d0be750 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:11.165915 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-399e10ec-86ed-4706-96bc-e8666d0be750 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:11.166343 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-399e10ec-86ed-4706-96bc-e8666d0be750 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:11.201369 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-399e10ec-86ed-4706-96bc-e8666d0be750 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:11.201843 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-399e10ec-86ed-4706-96bc-e8666d0be750 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:11.202314 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.objects.instance [None req-399e10ec-86ed-4706-96bc-e8666d0be750 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lazy-loading 'fault' on Instance uuid 2e21c8ef-c172-41cd-806e-f69f81116b6a {{(pid=118303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:15:11.253217 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-399e10ec-86ed-4706-96bc-e8666d0be750 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:11.261447 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-399e10ec-86ed-4706-96bc-e8666d0be750 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:11.263210 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-399e10ec-86ed-4706-96bc-e8666d0be750 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:11.264413 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-399e10ec-86ed-4706-96bc-e8666d0be750 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 200 len: 1371 microversion: 2.20 time: 0.112042 Aug 03 19:15:11.265317 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 403/802] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:15:11 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 1371 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:15:12.290349 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-0e3ac42f-976b-418b-9551-d5f207d3635e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:15:12.291180 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-0e3ac42f-976b-418b-9551-d5f207d3635e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:15:12.299631 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0e3ac42f-976b-418b-9551-d5f207d3635e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:12.300081 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0e3ac42f-976b-418b-9551-d5f207d3635e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:12.300881 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0e3ac42f-976b-418b-9551-d5f207d3635e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:12.301318 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0e3ac42f-976b-418b-9551-d5f207d3635e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:12.316902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.wsgi [None req-0e3ac42f-976b-418b-9551-d5f207d3635e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] HTTP exception thrown: Instance 2e21c8ef-c172-41cd-806e-f69f81116b6a could not be found. Aug 03 19:15:12.318559 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-0e3ac42f-976b-418b-9551-d5f207d3635e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Request method failure captured: Aug 03 19:15:12.318559 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: request: GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a HTTP/1.1 Aug 03 19:15:12.318559 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept: application/json Aug 03 19:15:12.318559 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept-Encoding: identity Aug 03 19:15:12.318559 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Connection: close Aug 03 19:15:12.318559 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Length: 0 Aug 03 19:15:12.318559 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Type: application/json Aug 03 19:15:12.318559 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Host: 10.222.0.77 Aug 03 19:15:12.318559 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Openstack-System-Scope: None Aug 03 19:15:12.318559 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: User-Agent: python-urllib3/1.26.11 Aug 03 19:15:12.318559 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Auth-Token: gAAAAABi6sgx46KEqIROZCyfP1h34-boPbWwPwd4T4Amm5Rx0Rx7moJYv2e0luuy3FqHtTHmnUgQ4o7xHrzlhTKXBRyo0ZiPWbXKR4cCBYx7LLgwlBoqsaLO8mEVikX_Hp3amqdlJtqy788Hx-BbzUBzZiKG8faaJoVotVZYD3MG0ZcVrz2bEXM Aug 03 19:15:12.318559 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Id: None Aug 03 19:15:12.318559 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Name: None Aug 03 19:15:12.318559 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Identity-Status: Confirmed Aug 03 19:15:12.318559 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Is-Admin-Project: True Aug 03 19:15:12.318559 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 19:15:12.318559 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Id: default Aug 03 19:15:12.318559 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Name: Default Aug 03 19:15:12.318559 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Id: fb9177b6619c48e38c20abcda2ebadd4 Aug 03 19:15:12.318559 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1411043165 Aug 03 19:15:12.318559 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Role: reader,member Aug 03 19:15:12.318559 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Roles: reader,member Aug 03 19:15:12.320815 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_fb9177b6619c48e38c20abcda2ebadd4", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/fb9177b6619c48e38c20abcda2ebadd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/fb9177b6619c48e38c20abcda2ebadd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/fb9177b6619c48e38c20abcda2ebadd4"}]}] Aug 03 19:15:12.320815 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1411043165 Aug 03 19:15:12.320815 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Id: fb9177b6619c48e38c20abcda2ebadd4 Aug 03 19:15:12.320815 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1411043165 Aug 03 19:15:12.320815 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User: tempest-AttachVolumeShelveTestJSON-1411043165-project Aug 03 19:15:12.320815 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Id: default Aug 03 19:15:12.320815 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Name: Default Aug 03 19:15:12.320815 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Id: 3ad3e2057063434a8938a6e1309782c4 Aug 03 19:15:12.320815 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1411043165-project Aug 03 19:15:12.320815 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: method: > Aug 03 19:15:12.320815 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: exception: Instance 2e21c8ef-c172-41cd-806e-f69f81116b6a could not be found. Aug 03 19:15:12.320815 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: action_args: {'id': '2e21c8ef-c172-41cd-806e-f69f81116b6a'} Aug 03 19:15:12.322464 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:15:12.322464 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:15:12.322464 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:15:12.322464 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:15:12.322464 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:15:12.322464 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:15:12.322464 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:15:12.322464 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:15:12.322464 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:15:12.322464 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:15:12.322464 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e21c8ef-c172-41cd-806e-f69f81116b6a could not be found. Aug 03 19:15:12.322464 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:15:12.322464 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:15:12.322464 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:15:12.322464 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:15:12.322464 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:15:12.322464 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:15:12.322464 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:15:12.322464 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:15:12.322464 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:15:12.324204 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:15:12.324204 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:15:12.324204 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:15:12.324204 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:15:12.324204 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:15:12.324204 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:15:12.324204 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:15:12.324204 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e21c8ef-c172-41cd-806e-f69f81116b6a could not be found. Aug 03 19:15:12.324204 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:15:12.324204 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:15:12.324204 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:15:12.324204 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:15:12.324204 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:15:12.324204 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:15:12.324204 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:15:12.324204 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:15:12.324204 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e21c8ef-c172-41cd-806e-f69f81116b6a could not be found. Aug 03 19:15:12.324204 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:15:12.325701 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-0e3ac42f-976b-418b-9551-d5f207d3635e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Returning 404 to user: Instance 2e21c8ef-c172-41cd-806e-f69f81116b6a could not be found. {{(pid=118302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:15:12.325701 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-0e3ac42f-976b-418b-9551-d5f207d3635e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 404 len: 111 microversion: 2.20 time: 0.034351 Aug 03 19:15:12.325701 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 400/803] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:15:12 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 03 19:15:12.335542 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-3d2067a8-e4b0-43c6-a8e7-276158546146 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '.version_select at 0x7f47861bff70>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:15:12.403954 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-3d2067a8-e4b0-43c6-a8e7-276158546146 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-933445005" status: 204 len: 0 microversion: 2.20 time: 0.072325 Aug 03 19:15:12.404698 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 404/804] 10.222.0.77 () {60 vars in 1259 bytes} [Wed Aug 3 19:15:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-933445005 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 03 19:15:13.177525 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-f921f42a-3608-4f78-966f-620e8a5c7c57 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Action: 'create', calling method: .version_select at 0x7f47880c29d0>, body: {"keypair": {"name": "tempest-keypair-1658208381", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJk11F+LQua+ml6rJS1Y7H6lfHRb42J88cCohVxjfbHp31I+eP0bVxwtNpOe+T5EyC4xEFEuNccuB6KMA/bdQYvWxBg9T/S7YAfdUJQ/cCKyJy1+hOFaUXL+rbuEUHKrA=="}} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:15:13.193833 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.quota [None req-f921f42a-3608-4f78-966f-620e8a5c7c57 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Getting quotas for project fb9177b6619c48e38c20abcda2ebadd4. Resources: {'key_pairs'} {{(pid=118302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:15:13.197605 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.quota [None req-f921f42a-3608-4f78-966f-620e8a5c7c57 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Getting quotas for user 3ad3e2057063434a8938a6e1309782c4 and project fb9177b6619c48e38c20abcda2ebadd4. Resources: {'key_pairs'} {{(pid=118302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:15:13.209912 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f921f42a-3608-4f78-966f-620e8a5c7c57 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [5f10b9a2-2359-4a9f-a97d-5dc018312453] AMQP server on 10.222.0.77:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 03 19:15:14.217581 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO oslo.messaging._drivers.impl_rabbit [None req-f921f42a-3608-4f78-966f-620e8a5c7c57 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [5f10b9a2-2359-4a9f-a97d-5dc018312453] Reconnected to AMQP server on 10.222.0.77:5672 via [amqp] client with port 48970. Aug 03 19:15:14.313730 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-f921f42a-3608-4f78-966f-620e8a5c7c57 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.140031 Aug 03 19:15:14.314331 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 401/805] 10.222.0.77 () {62 vars in 1200 bytes} [Wed Aug 3 19:15:13 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1141 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 03 19:15:16.608127 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-91746262-45f1-48f6-b16c-5fbaf4b72166 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-873238955", "imageRef": "0b6be242-215e-4886-a0d2-b8d5f8ca623e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "16f9ea0d-a806-47ec-9430-fa71c1c46ba2"}], "security_groups": [{"name": "tempest-securitygroup--2024299961"}], "key_name": "tempest-keypair-1658208381", "user_data": "}} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:15:16.720232 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.network.neutron [None req-91746262-45f1-48f6-b16c-5fbaf4b72166 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] validate_networks() for [('16f9ea0d-a806-47ec-9430-fa71c1c46ba2', None, None, None, None, None)] {{(pid=118303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 19:15:17.099309 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-91746262-45f1-48f6-b16c-5fbaf4b72166 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Flavor limits 0:0:0 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 19:15:17.099723 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-91746262-45f1-48f6-b16c-5fbaf4b72166 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Image limits 0:0:0 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 19:15:17.100190 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-91746262-45f1-48f6-b16c-5fbaf4b72166 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Flavor pref 0:0:0 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 19:15:17.100598 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-91746262-45f1-48f6-b16c-5fbaf4b72166 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Image pref 0:0:0 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 19:15:17.101003 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-91746262-45f1-48f6-b16c-5fbaf4b72166 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 19:15:17.111165 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-91746262-45f1-48f6-b16c-5fbaf4b72166 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:17.111606 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-91746262-45f1-48f6-b16c-5fbaf4b72166 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:17.112394 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-91746262-45f1-48f6-b16c-5fbaf4b72166 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:17.112824 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-91746262-45f1-48f6-b16c-5fbaf4b72166 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:17.132282 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.quota [None req-91746262-45f1-48f6-b16c-5fbaf4b72166 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Getting quotas for project fb9177b6619c48e38c20abcda2ebadd4. Resources: {'instances', 'cores', 'ram'} {{(pid=118303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:15:17.136237 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.quota [None req-91746262-45f1-48f6-b16c-5fbaf4b72166 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Getting quotas for user 3ad3e2057063434a8938a6e1309782c4 and project fb9177b6619c48e38c20abcda2ebadd4. Resources: {'instances', 'cores', 'ram'} {{(pid=118303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:15:17.147430 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-91746262-45f1-48f6-b16c-5fbaf4b72166 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Going to run 1 instances... {{(pid=118303) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 19:15:17.149644 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-91746262-45f1-48f6-b16c-5fbaf4b72166 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0b6be242-215e-4886-a0d2-b8d5f8ca623e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 19:15:17.278886 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-91746262-45f1-48f6-b16c-5fbaf4b72166 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.675837 Aug 03 19:15:17.279562 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 405/806] 10.222.0.77 () {62 vars in 1188 bytes} [Wed Aug 3 19:15:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 03 19:15:17.291989 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-a513da1c-0b1f-4a9c-995f-b0e3f440eed5 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:15:17.292766 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-a513da1c-0b1f-4a9c-995f-b0e3f440eed5 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:15:17.351790 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-a513da1c-0b1f-4a9c-995f-b0e3f440eed5 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:17.355293 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-a513da1c-0b1f-4a9c-995f-b0e3f440eed5 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:17.356787 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-a513da1c-0b1f-4a9c-995f-b0e3f440eed5 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:17.357884 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-a513da1c-0b1f-4a9c-995f-b0e3f440eed5 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1281 microversion: 2.20 time: 0.070610 Aug 03 19:15:17.359102 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 402/807] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:15:17 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1281 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:15:18.381352 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-83d8588b-1e88-4742-b4c1-fbba1f3fdb61 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:15:18.381992 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-83d8588b-1e88-4742-b4c1-fbba1f3fdb61 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:15:18.388213 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-83d8588b-1e88-4742-b4c1-fbba1f3fdb61 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:18.388666 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-83d8588b-1e88-4742-b4c1-fbba1f3fdb61 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:18.390170 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-83d8588b-1e88-4742-b4c1-fbba1f3fdb61 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:18.390488 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-83d8588b-1e88-4742-b4c1-fbba1f3fdb61 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:18.451650 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-83d8588b-1e88-4742-b4c1-fbba1f3fdb61 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:18.460363 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-83d8588b-1e88-4742-b4c1-fbba1f3fdb61 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:18.461864 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-83d8588b-1e88-4742-b4c1-fbba1f3fdb61 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:18.462971 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-83d8588b-1e88-4742-b4c1-fbba1f3fdb61 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1277 microversion: 2.20 time: 0.086030 Aug 03 19:15:18.463524 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 406/808] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:15:18 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1277 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:15:19.491018 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-e6340ccc-70b5-4373-8ae1-d3adc5c58f4b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:15:19.491563 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-e6340ccc-70b5-4373-8ae1-d3adc5c58f4b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:15:19.498072 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e6340ccc-70b5-4373-8ae1-d3adc5c58f4b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:19.498527 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e6340ccc-70b5-4373-8ae1-d3adc5c58f4b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:19.500026 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e6340ccc-70b5-4373-8ae1-d3adc5c58f4b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:19.500467 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e6340ccc-70b5-4373-8ae1-d3adc5c58f4b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:19.564089 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-e6340ccc-70b5-4373-8ae1-d3adc5c58f4b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:19.573905 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-e6340ccc-70b5-4373-8ae1-d3adc5c58f4b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:19.576012 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-e6340ccc-70b5-4373-8ae1-d3adc5c58f4b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:19.577290 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-e6340ccc-70b5-4373-8ae1-d3adc5c58f4b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1339 microversion: 2.20 time: 0.090377 Aug 03 19:15:19.577851 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 403/809] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:15:19 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1339 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:15:20.601702 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-a07273db-ce90-4c24-9905-436f4d2f9183 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:15:20.602370 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-a07273db-ce90-4c24-9905-436f4d2f9183 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:15:20.608904 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a07273db-ce90-4c24-9905-436f4d2f9183 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:20.609345 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a07273db-ce90-4c24-9905-436f4d2f9183 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:20.610107 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a07273db-ce90-4c24-9905-436f4d2f9183 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:20.610545 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a07273db-ce90-4c24-9905-436f4d2f9183 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:20.703504 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-2754a106-5bc4-4b58-aca2-0adb115b5cec req-a365cca2-adb0-4437-baa7-8679f0de97cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70e81dd2-02cb-482b-8f18-1babaf5146e2", "tag": "e271ef1f-3256-47c1-9a95-0979da44d6db"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:15:20.714723 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-2754a106-5bc4-4b58-aca2-0adb115b5cec req-a365cca2-adb0-4437-baa7-8679f0de97cc service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:20.715850 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-2754a106-5bc4-4b58-aca2-0adb115b5cec req-a365cca2-adb0-4437-baa7-8679f0de97cc service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:20.728457 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-2754a106-5bc4-4b58-aca2-0adb115b5cec req-a365cca2-adb0-4437-baa7-8679f0de97cc service nova] Creating event network-changed:e271ef1f-3256-47c1-9a95-0979da44d6db for instance 70e81dd2-02cb-482b-8f18-1babaf5146e2 on hv-cinder-85202 Aug 03 19:15:20.734155 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-2754a106-5bc4-4b58-aca2-0adb115b5cec req-a365cca2-adb0-4437-baa7-8679f0de97cc service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035684 Aug 03 19:15:20.735253 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 404/810] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 19:15:20.755783 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-a07273db-ce90-4c24-9905-436f4d2f9183 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:20.762799 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-a07273db-ce90-4c24-9905-436f4d2f9183 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:20.765310 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-a07273db-ce90-4c24-9905-436f4d2f9183 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:20.766897 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-a07273db-ce90-4c24-9905-436f4d2f9183 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1407 microversion: 2.20 time: 0.168972 Aug 03 19:15:20.767506 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 407/811] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:15:20 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 19:15:21.791114 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-77edde02-4dd7-42a0-9235-cb6c98ffa1bf tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:15:21.791811 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-77edde02-4dd7-42a0-9235-cb6c98ffa1bf tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:15:21.800663 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-77edde02-4dd7-42a0-9235-cb6c98ffa1bf tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:21.801115 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-77edde02-4dd7-42a0-9235-cb6c98ffa1bf tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:21.801878 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-77edde02-4dd7-42a0-9235-cb6c98ffa1bf tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:21.802310 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-77edde02-4dd7-42a0-9235-cb6c98ffa1bf tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:21.934541 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-77edde02-4dd7-42a0-9235-cb6c98ffa1bf tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:21.942594 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-77edde02-4dd7-42a0-9235-cb6c98ffa1bf tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:21.944168 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-77edde02-4dd7-42a0-9235-cb6c98ffa1bf tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:21.945273 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-77edde02-4dd7-42a0-9235-cb6c98ffa1bf tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1407 microversion: 2.20 time: 0.158538 Aug 03 19:15:21.945830 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 405/812] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:15:21 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:15:22.967142 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-e89a2ae6-9cb0-49d6-98a5-0f69e434236e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:15:22.968325 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-e89a2ae6-9cb0-49d6-98a5-0f69e434236e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:15:22.975226 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e89a2ae6-9cb0-49d6-98a5-0f69e434236e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:22.975675 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e89a2ae6-9cb0-49d6-98a5-0f69e434236e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:22.976433 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e89a2ae6-9cb0-49d6-98a5-0f69e434236e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:22.976867 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e89a2ae6-9cb0-49d6-98a5-0f69e434236e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:23.113933 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-e89a2ae6-9cb0-49d6-98a5-0f69e434236e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:23.122250 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-e89a2ae6-9cb0-49d6-98a5-0f69e434236e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:23.123809 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-e89a2ae6-9cb0-49d6-98a5-0f69e434236e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:23.125502 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-e89a2ae6-9cb0-49d6-98a5-0f69e434236e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1407 microversion: 2.20 time: 0.162457 Aug 03 19:15:23.126056 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 408/813] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:15:22 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 19:15:24.148676 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-6969fdf1-594e-4cba-bd0d-0cbcded57cdb tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:15:24.149229 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-6969fdf1-594e-4cba-bd0d-0cbcded57cdb tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:15:24.156507 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-6969fdf1-594e-4cba-bd0d-0cbcded57cdb tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:24.156958 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-6969fdf1-594e-4cba-bd0d-0cbcded57cdb tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:24.157720 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-6969fdf1-594e-4cba-bd0d-0cbcded57cdb tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:24.158158 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-6969fdf1-594e-4cba-bd0d-0cbcded57cdb tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:24.289090 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-6969fdf1-594e-4cba-bd0d-0cbcded57cdb tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:24.298602 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-6969fdf1-594e-4cba-bd0d-0cbcded57cdb tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:24.300139 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-6969fdf1-594e-4cba-bd0d-0cbcded57cdb tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:24.301253 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-6969fdf1-594e-4cba-bd0d-0cbcded57cdb tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1407 microversion: 2.20 time: 0.156610 Aug 03 19:15:24.301816 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 406/814] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:15:24 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:15:25.323949 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-bcab7ba8-60a4-4134-88fe-0f4dec43136f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:15:25.324580 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-bcab7ba8-60a4-4134-88fe-0f4dec43136f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:15:25.333156 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-bcab7ba8-60a4-4134-88fe-0f4dec43136f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:25.334346 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-bcab7ba8-60a4-4134-88fe-0f4dec43136f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:25.335287 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-bcab7ba8-60a4-4134-88fe-0f4dec43136f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:25.335713 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-bcab7ba8-60a4-4134-88fe-0f4dec43136f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:25.465629 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-bcab7ba8-60a4-4134-88fe-0f4dec43136f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:25.474732 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-bcab7ba8-60a4-4134-88fe-0f4dec43136f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:25.476265 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-bcab7ba8-60a4-4134-88fe-0f4dec43136f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:25.477366 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-bcab7ba8-60a4-4134-88fe-0f4dec43136f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1407 microversion: 2.20 time: 0.157470 Aug 03 19:15:25.477927 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 409/815] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:15:25 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:15:26.501751 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-16e12750-5945-4707-ab00-437d259802df tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:15:26.502196 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-16e12750-5945-4707-ab00-437d259802df tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:15:26.508721 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-16e12750-5945-4707-ab00-437d259802df tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:26.509228 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-16e12750-5945-4707-ab00-437d259802df tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:26.510000 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-16e12750-5945-4707-ab00-437d259802df tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:26.510438 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-16e12750-5945-4707-ab00-437d259802df tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:26.647740 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-16e12750-5945-4707-ab00-437d259802df tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:26.656145 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-16e12750-5945-4707-ab00-437d259802df tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:26.657651 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-16e12750-5945-4707-ab00-437d259802df tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:26.658754 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-16e12750-5945-4707-ab00-437d259802df tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1407 microversion: 2.20 time: 0.162724 Aug 03 19:15:26.659332 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 407/816] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:15:26 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:15:26.737894 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [req-fc2a3efc-6c22-4512-b245-8e871019e0a7 req-13caf4d3-fac8-46a6-976f-531e1e0026ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70e81dd2-02cb-482b-8f18-1babaf5146e2", "name": "network-vif-plugged", "status": "completed", "tag": "e271ef1f-3256-47c1-9a95-0979da44d6db"}]} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:15:26.748124 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-fc2a3efc-6c22-4512-b245-8e871019e0a7 req-13caf4d3-fac8-46a6-976f-531e1e0026ec service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:26.748706 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-fc2a3efc-6c22-4512-b245-8e871019e0a7 req-13caf4d3-fac8-46a6-976f-531e1e0026ec service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:26.760371 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.compute.server_external_events [req-fc2a3efc-6c22-4512-b245-8e871019e0a7 req-13caf4d3-fac8-46a6-976f-531e1e0026ec service nova] Creating event network-vif-plugged:e271ef1f-3256-47c1-9a95-0979da44d6db for instance 70e81dd2-02cb-482b-8f18-1babaf5146e2 on hv-cinder-85202 Aug 03 19:15:26.766158 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [req-fc2a3efc-6c22-4512-b245-8e871019e0a7 req-13caf4d3-fac8-46a6-976f-531e1e0026ec service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032069 Aug 03 19:15:26.771484 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 410/817] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:15:27.683079 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-36ec4b85-a556-40a5-b23e-0e4bf4c70114 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:15:27.683646 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-36ec4b85-a556-40a5-b23e-0e4bf4c70114 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:15:27.685712 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell0:SELECT=6 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:15:27.692684 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-36ec4b85-a556-40a5-b23e-0e4bf4c70114 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:27.693044 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-36ec4b85-a556-40a5-b23e-0e4bf4c70114 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:27.693819 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-36ec4b85-a556-40a5-b23e-0e4bf4c70114 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:27.694309 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-36ec4b85-a556-40a5-b23e-0e4bf4c70114 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:27.833021 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-36ec4b85-a556-40a5-b23e-0e4bf4c70114 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:27.840946 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-36ec4b85-a556-40a5-b23e-0e4bf4c70114 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:27.842957 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-36ec4b85-a556-40a5-b23e-0e4bf4c70114 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:27.844429 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-36ec4b85-a556-40a5-b23e-0e4bf4c70114 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1407 microversion: 2.20 time: 0.165478 Aug 03 19:15:27.844999 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 408/818] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:15:27 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:15:28.870425 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-ef6bd3ba-6e41-4962-ae25-ba8bf57f1937 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:15:28.871188 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-ef6bd3ba-6e41-4962-ae25-ba8bf57f1937 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:15:28.874446 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell0:SELECT=2 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:15:28.875531 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell0:SELECT=6 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:15:28.881818 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ef6bd3ba-6e41-4962-ae25-ba8bf57f1937 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:28.882261 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ef6bd3ba-6e41-4962-ae25-ba8bf57f1937 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:28.883120 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ef6bd3ba-6e41-4962-ae25-ba8bf57f1937 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:28.883483 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ef6bd3ba-6e41-4962-ae25-ba8bf57f1937 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:29.032056 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-ef6bd3ba-6e41-4962-ae25-ba8bf57f1937 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:29.040202 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-ef6bd3ba-6e41-4962-ae25-ba8bf57f1937 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:29.041939 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-ef6bd3ba-6e41-4962-ae25-ba8bf57f1937 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:29.043062 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-ef6bd3ba-6e41-4962-ae25-ba8bf57f1937 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1407 microversion: 2.20 time: 0.178290 Aug 03 19:15:29.043624 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 411/819] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:15:28 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:15:30.067387 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-9e8a26a5-2056-41dc-a3df-16d09b1bdfc8 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:15:30.067944 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-9e8a26a5-2056-41dc-a3df-16d09b1bdfc8 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:15:30.074501 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9e8a26a5-2056-41dc-a3df-16d09b1bdfc8 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:30.075095 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9e8a26a5-2056-41dc-a3df-16d09b1bdfc8 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:30.075852 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9e8a26a5-2056-41dc-a3df-16d09b1bdfc8 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:30.076284 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9e8a26a5-2056-41dc-a3df-16d09b1bdfc8 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:30.216773 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-9e8a26a5-2056-41dc-a3df-16d09b1bdfc8 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:30.225680 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-9e8a26a5-2056-41dc-a3df-16d09b1bdfc8 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:30.227221 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-9e8a26a5-2056-41dc-a3df-16d09b1bdfc8 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:15:30.228511 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-9e8a26a5-2056-41dc-a3df-16d09b1bdfc8 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1599 microversion: 2.20 time: 0.164927 Aug 03 19:15:30.228972 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 409/820] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:15:30 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1599 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:15:30.252636 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-2cb62222-e6c8-4a81-b319-0297def470ad tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:15:30.253025 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-2cb62222-e6c8-4a81-b319-0297def470ad tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:15:30.259280 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2cb62222-e6c8-4a81-b319-0297def470ad tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:30.259746 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2cb62222-e6c8-4a81-b319-0297def470ad tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:30.260572 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2cb62222-e6c8-4a81-b319-0297def470ad tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:30.261004 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2cb62222-e6c8-4a81-b319-0297def470ad tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:30.343843 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-2cb62222-e6c8-4a81-b319-0297def470ad tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.096540 Aug 03 19:15:30.344435 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 412/821] 10.222.0.77 () {60 vars in 1316 bytes} [Wed Aug 3 19:15:30 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 19:15:31.396008 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-01a9beac-82ed-4e4b-8ae0-cbf843d629e2 req-7610f113-6193-4741-85bc-d0ffacc4ede8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70e81dd2-02cb-482b-8f18-1babaf5146e2", "tag": "e271ef1f-3256-47c1-9a95-0979da44d6db"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:15:31.406513 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-01a9beac-82ed-4e4b-8ae0-cbf843d629e2 req-7610f113-6193-4741-85bc-d0ffacc4ede8 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:15:31.406971 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-01a9beac-82ed-4e4b-8ae0-cbf843d629e2 req-7610f113-6193-4741-85bc-d0ffacc4ede8 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:15:31.419372 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-01a9beac-82ed-4e4b-8ae0-cbf843d629e2 req-7610f113-6193-4741-85bc-d0ffacc4ede8 service nova] Creating event network-changed:e271ef1f-3256-47c1-9a95-0979da44d6db for instance 70e81dd2-02cb-482b-8f18-1babaf5146e2 on hv-cinder-85202 Aug 03 19:15:31.425173 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-01a9beac-82ed-4e4b-8ae0-cbf843d629e2 req-7610f113-6193-4741-85bc-d0ffacc4ede8 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033063 Aug 03 19:15:31.425962 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 410/822] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:16:17.705363 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:16:17.706275 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=76 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:16:17.710173 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-5e90744f-69d1-45bd-bc1a-a567a45cfc89 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:16:17.710613 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-56da531f-ac24-4eb1-85a3-ac56683ae3ab req-a6a8af75-ff6c-4cfe-957d-b7cf08c1a54e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c125b049-e40d-48d8-99a0-e3113210600c", "tag": "7cb7ee7d-4150-401a-bde3-ea2e666acbf8"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:16:17.711153 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-5e90744f-69d1-45bd-bc1a-a567a45cfc89 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c125b049-e40d-48d8-99a0-e3113210600c] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:16:17.717172 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5e90744f-69d1-45bd-bc1a-a567a45cfc89 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:17.719840 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5e90744f-69d1-45bd-bc1a-a567a45cfc89 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:17.720000 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5e90744f-69d1-45bd-bc1a-a567a45cfc89 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:17.720657 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5e90744f-69d1-45bd-bc1a-a567a45cfc89 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:17.722336 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:16:17.723073 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:16:17.725287 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-56da531f-ac24-4eb1-85a3-ac56683ae3ab req-a6a8af75-ff6c-4cfe-957d-b7cf08c1a54e service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:17.725741 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-56da531f-ac24-4eb1-85a3-ac56683ae3ab req-a6a8af75-ff6c-4cfe-957d-b7cf08c1a54e service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:17.738714 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-56da531f-ac24-4eb1-85a3-ac56683ae3ab req-a6a8af75-ff6c-4cfe-957d-b7cf08c1a54e service nova] Creating event network-changed:7cb7ee7d-4150-401a-bde3-ea2e666acbf8 for instance c125b049-e40d-48d8-99a0-e3113210600c on hv-cinder-85202 Aug 03 19:16:17.744017 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-56da531f-ac24-4eb1-85a3-ac56683ae3ab req-a6a8af75-ff6c-4cfe-957d-b7cf08c1a54e service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037912 Aug 03 19:16:17.745018 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 411/823] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:16:17.749911 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-5e90744f-69d1-45bd-bc1a-a567a45cfc89 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c125b049-e40d-48d8-99a0-e3113210600c] Going to try to terminate instance {{(pid=118303) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 19:16:18.111775 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-5e90744f-69d1-45bd-bc1a-a567a45cfc89 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "DELETE /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c" status: 204 len: 0 microversion: 2.1 time: 0.407523 Aug 03 19:16:18.116176 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 413/824] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 3 19:16:17 2022] DELETE /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 19:16:18.122600 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-31d5bcd7-59b0-4153-aaba-17632428c626 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:16:18.123745 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-31d5bcd7-59b0-4153-aaba-17632428c626 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c125b049-e40d-48d8-99a0-e3113210600c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:16:18.131268 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-31d5bcd7-59b0-4153-aaba-17632428c626 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:18.132108 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-31d5bcd7-59b0-4153-aaba-17632428c626 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:18.133131 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-31d5bcd7-59b0-4153-aaba-17632428c626 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:18.133800 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-31d5bcd7-59b0-4153-aaba-17632428c626 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:18.286635 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-31d5bcd7-59b0-4153-aaba-17632428c626 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:16:18.298506 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-31d5bcd7-59b0-4153-aaba-17632428c626 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c" status: 200 len: 1576 microversion: 2.1 time: 0.180827 Aug 03 19:16:18.299132 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 412/825] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:16:18 2022] GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c => generated 1576 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:16:19.320514 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-40af99a6-0642-453e-9b19-814511afd3c1 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:16:19.321341 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-40af99a6-0642-453e-9b19-814511afd3c1 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c125b049-e40d-48d8-99a0-e3113210600c] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:16:19.327802 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-40af99a6-0642-453e-9b19-814511afd3c1 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:19.328246 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-40af99a6-0642-453e-9b19-814511afd3c1 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:19.329012 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-40af99a6-0642-453e-9b19-814511afd3c1 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:19.329446 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-40af99a6-0642-453e-9b19-814511afd3c1 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:19.465492 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-40af99a6-0642-453e-9b19-814511afd3c1 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:16:19.473600 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-40af99a6-0642-453e-9b19-814511afd3c1 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c" status: 200 len: 1576 microversion: 2.1 time: 0.158650 Aug 03 19:16:19.474299 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 414/826] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:16:19 2022] GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:16:20.496984 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-fe92e22a-087a-45cc-a4b6-966cf334bb79 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:16:20.497668 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-fe92e22a-087a-45cc-a4b6-966cf334bb79 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c125b049-e40d-48d8-99a0-e3113210600c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:16:20.505240 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fe92e22a-087a-45cc-a4b6-966cf334bb79 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:20.505959 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fe92e22a-087a-45cc-a4b6-966cf334bb79 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:20.507080 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fe92e22a-087a-45cc-a4b6-966cf334bb79 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:20.507531 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fe92e22a-087a-45cc-a4b6-966cf334bb79 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:20.655642 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-fe92e22a-087a-45cc-a4b6-966cf334bb79 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:16:20.666061 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-fe92e22a-087a-45cc-a4b6-966cf334bb79 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c" status: 200 len: 1458 microversion: 2.1 time: 0.173304 Aug 03 19:16:20.673480 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [req-96351ed8-d455-4f1e-ab3f-7b0068a99bfa req-0ad522fe-123e-423b-86ed-32d5cb3cff2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c125b049-e40d-48d8-99a0-e3113210600c", "name": "network-vif-deleted", "tag": "7cb7ee7d-4150-401a-bde3-ea2e666acbf8"}]} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:16:20.680707 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 413/827] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:16:20 2022] GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c => generated 1458 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:16:20.684429 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-96351ed8-d455-4f1e-ab3f-7b0068a99bfa req-0ad522fe-123e-423b-86ed-32d5cb3cff2e service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:20.684874 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-96351ed8-d455-4f1e-ab3f-7b0068a99bfa req-0ad522fe-123e-423b-86ed-32d5cb3cff2e service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:20.698436 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.compute.server_external_events [req-96351ed8-d455-4f1e-ab3f-7b0068a99bfa req-0ad522fe-123e-423b-86ed-32d5cb3cff2e service nova] Creating event network-vif-deleted:7cb7ee7d-4150-401a-bde3-ea2e666acbf8 for instance c125b049-e40d-48d8-99a0-e3113210600c on hv-cinder-85202 Aug 03 19:16:20.704315 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [req-96351ed8-d455-4f1e-ab3f-7b0068a99bfa req-0ad522fe-123e-423b-86ed-32d5cb3cff2e service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035951 Aug 03 19:16:20.705100 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 415/828] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:16:21.702473 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-8eafbab1-1797-4b17-8ab5-091054db15a6 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:16:21.703686 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-8eafbab1-1797-4b17-8ab5-091054db15a6 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c125b049-e40d-48d8-99a0-e3113210600c] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:16:21.710536 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8eafbab1-1797-4b17-8ab5-091054db15a6 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:21.711016 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8eafbab1-1797-4b17-8ab5-091054db15a6 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:21.711798 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8eafbab1-1797-4b17-8ab5-091054db15a6 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:21.712239 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8eafbab1-1797-4b17-8ab5-091054db15a6 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:21.744178 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8eafbab1-1797-4b17-8ab5-091054db15a6 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:21.744629 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8eafbab1-1797-4b17-8ab5-091054db15a6 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:21.745074 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.objects.instance [None req-8eafbab1-1797-4b17-8ab5-091054db15a6 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lazy-loading 'fault' on Instance uuid c125b049-e40d-48d8-99a0-e3113210600c {{(pid=118302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:16:21.788015 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-8eafbab1-1797-4b17-8ab5-091054db15a6 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:16:21.796719 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-8eafbab1-1797-4b17-8ab5-091054db15a6 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c" status: 200 len: 1231 microversion: 2.1 time: 0.098230 Aug 03 19:16:21.797566 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 414/829] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:16:21 2022] GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c => generated 1231 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:16:22.819605 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-7d79d5f3-d4ee-46bb-87af-6ba2e190540c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:16:22.820309 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-7d79d5f3-d4ee-46bb-87af-6ba2e190540c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c125b049-e40d-48d8-99a0-e3113210600c] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:16:22.829928 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-7d79d5f3-d4ee-46bb-87af-6ba2e190540c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:22.829928 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-7d79d5f3-d4ee-46bb-87af-6ba2e190540c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:22.829928 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-7d79d5f3-d4ee-46bb-87af-6ba2e190540c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:22.829928 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-7d79d5f3-d4ee-46bb-87af-6ba2e190540c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:22.842005 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.wsgi [None req-7d79d5f3-d4ee-46bb-87af-6ba2e190540c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] HTTP exception thrown: Instance c125b049-e40d-48d8-99a0-e3113210600c could not be found. Aug 03 19:16:22.843667 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-7d79d5f3-d4ee-46bb-87af-6ba2e190540c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Request method failure captured: Aug 03 19:16:22.843667 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: request: GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c HTTP/1.1 Aug 03 19:16:22.843667 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept: application/json Aug 03 19:16:22.843667 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept-Encoding: identity Aug 03 19:16:22.843667 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Connection: close Aug 03 19:16:22.843667 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Length: 0 Aug 03 19:16:22.843667 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Type: application/json Aug 03 19:16:22.843667 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Host: 10.222.0.77 Aug 03 19:16:22.843667 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Openstack-System-Scope: None Aug 03 19:16:22.843667 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: User-Agent: python-urllib3/1.26.11 Aug 03 19:16:22.843667 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Auth-Token: gAAAAABi6sdffadQLm_E0CMgfxe8VavQQNtbdEarH7kyUCUjHdvSPyOchPO7DzYV4pw-cc1aAp83qyPjmYENqcVFbn1Zsm30Otk2xeNjKmUa3NN7dYoxj5hOEk5rjmk5HZU01I04OW2Nw6NW3uDOY1FOzqGjBbgVXquzADEZ1oOtmyGixErsioc Aug 03 19:16:22.843667 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Id: None Aug 03 19:16:22.843667 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Name: None Aug 03 19:16:22.843667 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Identity-Status: Confirmed Aug 03 19:16:22.843667 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Is-Admin-Project: True Aug 03 19:16:22.843667 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Id: default Aug 03 19:16:22.843667 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Name: Default Aug 03 19:16:22.843667 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Id: 28d15350ea8f45b490bb080384999f4b Aug 03 19:16:22.843667 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Name: tempest-TestVolumeBootPattern-2001643055 Aug 03 19:16:22.843667 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Role: reader,member Aug 03 19:16:22.843667 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Roles: reader,member Aug 03 19:16:22.845221 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_28d15350ea8f45b490bb080384999f4b", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/28d15350ea8f45b490bb080384999f4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/28d15350ea8f45b490bb080384999f4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/28d15350ea8f45b490bb080384999f4b"}]}] Aug 03 19:16:22.845221 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant: tempest-TestVolumeBootPattern-2001643055 Aug 03 19:16:22.845221 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Id: 28d15350ea8f45b490bb080384999f4b Aug 03 19:16:22.845221 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Name: tempest-TestVolumeBootPattern-2001643055 Aug 03 19:16:22.845221 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User: tempest-TestVolumeBootPattern-2001643055-project Aug 03 19:16:22.845221 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Id: default Aug 03 19:16:22.845221 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Name: Default Aug 03 19:16:22.845221 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Id: 626fe64980ed40d4bbb829c75dc0067c Aug 03 19:16:22.845221 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Name: tempest-TestVolumeBootPattern-2001643055-project Aug 03 19:16:22.845221 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: method: > Aug 03 19:16:22.845221 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: exception: Instance c125b049-e40d-48d8-99a0-e3113210600c could not be found. Aug 03 19:16:22.845221 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: action_args: {'id': 'c125b049-e40d-48d8-99a0-e3113210600c'} Aug 03 19:16:22.846043 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:16:22.846043 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:16:22.846043 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:16:22.846043 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:16:22.846043 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:16:22.846043 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:16:22.846043 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:16:22.846043 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:16:22.846043 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:16:22.846043 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:16:22.846043 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c125b049-e40d-48d8-99a0-e3113210600c could not be found. Aug 03 19:16:22.846043 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:16:22.846043 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:16:22.846043 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:16:22.846043 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:16:22.846043 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:16:22.846043 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:16:22.846043 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:16:22.846043 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:16:22.846043 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:16:22.847420 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:16:22.847420 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:16:22.847420 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:16:22.847420 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:16:22.847420 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:16:22.847420 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:16:22.847420 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:16:22.847420 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c125b049-e40d-48d8-99a0-e3113210600c could not be found. Aug 03 19:16:22.847420 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:16:22.847420 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:16:22.847420 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:16:22.847420 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:16:22.847420 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:16:22.847420 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:16:22.847420 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:16:22.847420 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:16:22.847420 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c125b049-e40d-48d8-99a0-e3113210600c could not be found. Aug 03 19:16:22.847420 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:16:22.848607 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-7d79d5f3-d4ee-46bb-87af-6ba2e190540c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Returning 404 to user: Instance c125b049-e40d-48d8-99a0-e3113210600c could not be found. {{(pid=118303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:16:22.848607 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-7d79d5f3-d4ee-46bb-87af-6ba2e190540c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c" status: 404 len: 111 microversion: 2.1 time: 0.030341 Aug 03 19:16:22.848607 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 416/830] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:16:22 2022] GET /compute/v2.1/servers/c125b049-e40d-48d8-99a0-e3113210600c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:16:26.321973 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-370551f1-2653-4550-96ad-ce299c980385 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:16:26.322560 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-370551f1-2653-4550-96ad-ce299c980385 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c33c4d48-ab10-4a55-aca5-b86ad860a568] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:16:26.334615 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-370551f1-2653-4550-96ad-ce299c980385 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:26.335611 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-370551f1-2653-4550-96ad-ce299c980385 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:26.336784 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-370551f1-2653-4550-96ad-ce299c980385 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:26.337490 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-370551f1-2653-4550-96ad-ce299c980385 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:26.367272 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-370551f1-2653-4550-96ad-ce299c980385 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c33c4d48-ab10-4a55-aca5-b86ad860a568] Going to try to terminate instance {{(pid=118302) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 19:16:26.473426 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [req-8c15adea-6c8e-49c9-8e56-eaf6515f808f req-17a42681-46dd-49b6-bc0c-0193153e7933 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c33c4d48-ab10-4a55-aca5-b86ad860a568", "tag": "00320519-cf37-4866-9293-f5f51d93d44e"}]} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:16:26.490987 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-8c15adea-6c8e-49c9-8e56-eaf6515f808f req-17a42681-46dd-49b6-bc0c-0193153e7933 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:26.503381 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-8c15adea-6c8e-49c9-8e56-eaf6515f808f req-17a42681-46dd-49b6-bc0c-0193153e7933 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:26.510427 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.compute.server_external_events [req-8c15adea-6c8e-49c9-8e56-eaf6515f808f req-17a42681-46dd-49b6-bc0c-0193153e7933 service nova] Creating event network-changed:00320519-cf37-4866-9293-f5f51d93d44e for instance c33c4d48-ab10-4a55-aca5-b86ad860a568 on hv-cinder-85202 Aug 03 19:16:26.518036 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [req-8c15adea-6c8e-49c9-8e56-eaf6515f808f req-17a42681-46dd-49b6-bc0c-0193153e7933 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.201478 Aug 03 19:16:26.520286 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 417/831] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 19:16:26.660059 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-370551f1-2653-4550-96ad-ce299c980385 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "DELETE /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568" status: 204 len: 0 microversion: 2.1 time: 0.347070 Aug 03 19:16:26.665585 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 415/832] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 3 19:16:26 2022] DELETE /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 19:16:26.673062 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-b48143cf-5a13-4e74-8932-7b328b3c5042 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:16:26.674102 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-b48143cf-5a13-4e74-8932-7b328b3c5042 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c33c4d48-ab10-4a55-aca5-b86ad860a568] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:16:26.680966 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b48143cf-5a13-4e74-8932-7b328b3c5042 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:26.681647 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b48143cf-5a13-4e74-8932-7b328b3c5042 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:26.682505 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b48143cf-5a13-4e74-8932-7b328b3c5042 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:26.683176 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b48143cf-5a13-4e74-8932-7b328b3c5042 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:26.852611 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-b48143cf-5a13-4e74-8932-7b328b3c5042 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:16:26.867504 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-b48143cf-5a13-4e74-8932-7b328b3c5042 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568" status: 200 len: 1576 microversion: 2.1 time: 0.199548 Aug 03 19:16:26.871025 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 418/833] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:16:26 2022] GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568 => generated 1576 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:16:27.891758 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-cc802875-f9ea-4222-8ed9-6db7d82923fa tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:16:27.892378 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-cc802875-f9ea-4222-8ed9-6db7d82923fa tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c33c4d48-ab10-4a55-aca5-b86ad860a568] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:16:27.898912 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-cc802875-f9ea-4222-8ed9-6db7d82923fa tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:27.899389 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-cc802875-f9ea-4222-8ed9-6db7d82923fa tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:27.900160 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-cc802875-f9ea-4222-8ed9-6db7d82923fa tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:27.900593 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-cc802875-f9ea-4222-8ed9-6db7d82923fa tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:28.073130 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-cc802875-f9ea-4222-8ed9-6db7d82923fa tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:16:28.081565 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-cc802875-f9ea-4222-8ed9-6db7d82923fa tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568" status: 200 len: 1458 microversion: 2.1 time: 0.195439 Aug 03 19:16:28.084744 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 416/834] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:16:27 2022] GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568 => generated 1458 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:16:28.130011 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [req-f90d6a10-9606-4f8f-a2f1-f6003b239733 req-6dc0c622-7453-422c-b36b-92ebd03e701e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c33c4d48-ab10-4a55-aca5-b86ad860a568", "name": "network-vif-deleted", "tag": "00320519-cf37-4866-9293-f5f51d93d44e"}]} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:16:28.141309 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-f90d6a10-9606-4f8f-a2f1-f6003b239733 req-6dc0c622-7453-422c-b36b-92ebd03e701e service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:28.142158 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-f90d6a10-9606-4f8f-a2f1-f6003b239733 req-6dc0c622-7453-422c-b36b-92ebd03e701e service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:28.154156 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.compute.server_external_events [req-f90d6a10-9606-4f8f-a2f1-f6003b239733 req-6dc0c622-7453-422c-b36b-92ebd03e701e service nova] Creating event network-vif-deleted:00320519-cf37-4866-9293-f5f51d93d44e for instance c33c4d48-ab10-4a55-aca5-b86ad860a568 on hv-cinder-85202 Aug 03 19:16:28.159673 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [req-f90d6a10-9606-4f8f-a2f1-f6003b239733 req-6dc0c622-7453-422c-b36b-92ebd03e701e service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036226 Aug 03 19:16:28.163446 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 419/835] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:16:28.185633 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 19:16:28.186767 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Wed Aug 3 19:16:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 19:16:29.101779 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-04e4c0b3-7dca-4119-afa3-2adda85da198 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:16:29.102467 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-04e4c0b3-7dca-4119-afa3-2adda85da198 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c33c4d48-ab10-4a55-aca5-b86ad860a568] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:16:29.110034 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-04e4c0b3-7dca-4119-afa3-2adda85da198 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:29.110478 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-04e4c0b3-7dca-4119-afa3-2adda85da198 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:29.111290 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-04e4c0b3-7dca-4119-afa3-2adda85da198 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:29.111743 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-04e4c0b3-7dca-4119-afa3-2adda85da198 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:29.143204 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-04e4c0b3-7dca-4119-afa3-2adda85da198 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:29.143649 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-04e4c0b3-7dca-4119-afa3-2adda85da198 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:29.144096 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.objects.instance [None req-04e4c0b3-7dca-4119-afa3-2adda85da198 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lazy-loading 'fault' on Instance uuid c33c4d48-ab10-4a55-aca5-b86ad860a568 {{(pid=118302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:16:29.186446 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-04e4c0b3-7dca-4119-afa3-2adda85da198 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626fe64980ed40d4bbb829c75dc0067c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d15350ea8f45b490bb080384999f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:16:29.194543 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-04e4c0b3-7dca-4119-afa3-2adda85da198 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568" status: 200 len: 1230 microversion: 2.1 time: 0.096617 Aug 03 19:16:29.195402 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 417/836] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:16:29 2022] GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568 => generated 1230 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:16:30.216486 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-75691ef0-b447-44b1-a4a9-0da506751124 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:16:30.217271 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-75691ef0-b447-44b1-a4a9-0da506751124 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: c33c4d48-ab10-4a55-aca5-b86ad860a568] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:16:30.224394 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-75691ef0-b447-44b1-a4a9-0da506751124 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:30.224842 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-75691ef0-b447-44b1-a4a9-0da506751124 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:30.225609 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-75691ef0-b447-44b1-a4a9-0da506751124 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:30.226045 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-75691ef0-b447-44b1-a4a9-0da506751124 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:30.240450 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.wsgi [None req-75691ef0-b447-44b1-a4a9-0da506751124 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] HTTP exception thrown: Instance c33c4d48-ab10-4a55-aca5-b86ad860a568 could not be found. Aug 03 19:16:30.242120 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-75691ef0-b447-44b1-a4a9-0da506751124 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Request method failure captured: Aug 03 19:16:30.242120 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: request: GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568 HTTP/1.1 Aug 03 19:16:30.242120 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept: application/json Aug 03 19:16:30.242120 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept-Encoding: identity Aug 03 19:16:30.242120 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Connection: close Aug 03 19:16:30.242120 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Length: 0 Aug 03 19:16:30.242120 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Type: application/json Aug 03 19:16:30.242120 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Host: 10.222.0.77 Aug 03 19:16:30.242120 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Openstack-System-Scope: None Aug 03 19:16:30.242120 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: User-Agent: python-urllib3/1.26.11 Aug 03 19:16:30.242120 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Auth-Token: gAAAAABi6sdffadQLm_E0CMgfxe8VavQQNtbdEarH7kyUCUjHdvSPyOchPO7DzYV4pw-cc1aAp83qyPjmYENqcVFbn1Zsm30Otk2xeNjKmUa3NN7dYoxj5hOEk5rjmk5HZU01I04OW2Nw6NW3uDOY1FOzqGjBbgVXquzADEZ1oOtmyGixErsioc Aug 03 19:16:30.242120 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Id: None Aug 03 19:16:30.242120 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Name: None Aug 03 19:16:30.242120 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Identity-Status: Confirmed Aug 03 19:16:30.242120 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Is-Admin-Project: True Aug 03 19:16:30.242120 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Id: default Aug 03 19:16:30.242120 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Name: Default Aug 03 19:16:30.242120 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Id: 28d15350ea8f45b490bb080384999f4b Aug 03 19:16:30.242120 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Name: tempest-TestVolumeBootPattern-2001643055 Aug 03 19:16:30.242120 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Role: reader,member Aug 03 19:16:30.242120 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Roles: reader,member Aug 03 19:16:30.243856 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_28d15350ea8f45b490bb080384999f4b", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/28d15350ea8f45b490bb080384999f4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/28d15350ea8f45b490bb080384999f4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/28d15350ea8f45b490bb080384999f4b"}]}] Aug 03 19:16:30.243856 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant: tempest-TestVolumeBootPattern-2001643055 Aug 03 19:16:30.243856 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Id: 28d15350ea8f45b490bb080384999f4b Aug 03 19:16:30.243856 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Name: tempest-TestVolumeBootPattern-2001643055 Aug 03 19:16:30.243856 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User: tempest-TestVolumeBootPattern-2001643055-project Aug 03 19:16:30.243856 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Id: default Aug 03 19:16:30.243856 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Name: Default Aug 03 19:16:30.243856 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Id: 626fe64980ed40d4bbb829c75dc0067c Aug 03 19:16:30.243856 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Name: tempest-TestVolumeBootPattern-2001643055-project Aug 03 19:16:30.243856 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: method: > Aug 03 19:16:30.243856 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: exception: Instance c33c4d48-ab10-4a55-aca5-b86ad860a568 could not be found. Aug 03 19:16:30.243856 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: action_args: {'id': 'c33c4d48-ab10-4a55-aca5-b86ad860a568'} Aug 03 19:16:30.245014 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:16:30.245014 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:16:30.245014 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:16:30.245014 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:16:30.245014 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:16:30.245014 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:16:30.245014 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:16:30.245014 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:16:30.245014 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:16:30.245014 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:16:30.245014 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c33c4d48-ab10-4a55-aca5-b86ad860a568 could not be found. Aug 03 19:16:30.245014 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:16:30.245014 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:16:30.245014 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:16:30.245014 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:16:30.245014 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:16:30.245014 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:16:30.245014 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:16:30.245014 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:16:30.245014 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:16:30.246268 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:16:30.246268 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:16:30.246268 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:16:30.246268 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:16:30.246268 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:16:30.246268 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:16:30.246268 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:16:30.246268 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c33c4d48-ab10-4a55-aca5-b86ad860a568 could not be found. Aug 03 19:16:30.246268 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:16:30.246268 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:16:30.246268 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:16:30.246268 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:16:30.246268 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:16:30.246268 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:16:30.246268 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:16:30.246268 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:16:30.246268 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c33c4d48-ab10-4a55-aca5-b86ad860a568 could not be found. Aug 03 19:16:30.246268 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:16:30.247577 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-75691ef0-b447-44b1-a4a9-0da506751124 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Returning 404 to user: Instance c33c4d48-ab10-4a55-aca5-b86ad860a568 could not be found. {{(pid=118303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:16:30.247577 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-75691ef0-b447-44b1-a4a9-0da506751124 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568" status: 404 len: 111 microversion: 2.1 time: 0.031524 Aug 03 19:16:30.247577 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 420/837] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:16:30 2022] GET /compute/v2.1/servers/c33c4d48-ab10-4a55-aca5-b86ad860a568 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 19:16:30.825921 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-609af5f0-3412-4e9f-97a1-b97f764df11c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:16:30.826815 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-609af5f0-3412-4e9f-97a1-b97f764df11c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: 483630e6-3fee-46ff-8bd2-5031a27f8696] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:16:30.833306 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-609af5f0-3412-4e9f-97a1-b97f764df11c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:30.833744 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-609af5f0-3412-4e9f-97a1-b97f764df11c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:30.834515 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-609af5f0-3412-4e9f-97a1-b97f764df11c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:30.834979 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-609af5f0-3412-4e9f-97a1-b97f764df11c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:30.849818 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.wsgi [None req-609af5f0-3412-4e9f-97a1-b97f764df11c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] HTTP exception thrown: Instance 483630e6-3fee-46ff-8bd2-5031a27f8696 could not be found. Aug 03 19:16:30.851547 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-609af5f0-3412-4e9f-97a1-b97f764df11c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Request method failure captured: Aug 03 19:16:30.851547 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: request: DELETE /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696 HTTP/1.1 Aug 03 19:16:30.851547 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept: application/json Aug 03 19:16:30.851547 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept-Encoding: identity Aug 03 19:16:30.851547 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Connection: close Aug 03 19:16:30.851547 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Length: 0 Aug 03 19:16:30.851547 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Type: application/json Aug 03 19:16:30.851547 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Host: 10.222.0.77 Aug 03 19:16:30.851547 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Openstack-System-Scope: None Aug 03 19:16:30.851547 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: User-Agent: python-urllib3/1.26.11 Aug 03 19:16:30.851547 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Auth-Token: gAAAAABi6sdffadQLm_E0CMgfxe8VavQQNtbdEarH7kyUCUjHdvSPyOchPO7DzYV4pw-cc1aAp83qyPjmYENqcVFbn1Zsm30Otk2xeNjKmUa3NN7dYoxj5hOEk5rjmk5HZU01I04OW2Nw6NW3uDOY1FOzqGjBbgVXquzADEZ1oOtmyGixErsioc Aug 03 19:16:30.851547 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Id: None Aug 03 19:16:30.851547 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Name: None Aug 03 19:16:30.851547 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Identity-Status: Confirmed Aug 03 19:16:30.851547 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Is-Admin-Project: True Aug 03 19:16:30.851547 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Id: default Aug 03 19:16:30.851547 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Name: Default Aug 03 19:16:30.851547 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Id: 28d15350ea8f45b490bb080384999f4b Aug 03 19:16:30.851547 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Name: tempest-TestVolumeBootPattern-2001643055 Aug 03 19:16:30.851547 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Role: reader,member Aug 03 19:16:30.851547 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Roles: reader,member Aug 03 19:16:30.854311 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_28d15350ea8f45b490bb080384999f4b", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/28d15350ea8f45b490bb080384999f4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/28d15350ea8f45b490bb080384999f4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/28d15350ea8f45b490bb080384999f4b"}]}] Aug 03 19:16:30.854311 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant: tempest-TestVolumeBootPattern-2001643055 Aug 03 19:16:30.854311 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Id: 28d15350ea8f45b490bb080384999f4b Aug 03 19:16:30.854311 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Name: tempest-TestVolumeBootPattern-2001643055 Aug 03 19:16:30.854311 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User: tempest-TestVolumeBootPattern-2001643055-project Aug 03 19:16:30.854311 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Id: default Aug 03 19:16:30.854311 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Name: Default Aug 03 19:16:30.854311 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Id: 626fe64980ed40d4bbb829c75dc0067c Aug 03 19:16:30.854311 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Name: tempest-TestVolumeBootPattern-2001643055-project Aug 03 19:16:30.854311 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: method: > Aug 03 19:16:30.854311 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: exception: Instance 483630e6-3fee-46ff-8bd2-5031a27f8696 could not be found. Aug 03 19:16:30.854311 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: action_args: {'id': '483630e6-3fee-46ff-8bd2-5031a27f8696'} Aug 03 19:16:30.855824 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:16:30.855824 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:16:30.855824 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:16:30.855824 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:16:30.855824 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:16:30.855824 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:16:30.855824 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:16:30.855824 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:16:30.855824 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:16:30.855824 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:16:30.855824 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 483630e6-3fee-46ff-8bd2-5031a27f8696 could not be found. Aug 03 19:16:30.855824 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:16:30.855824 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:16:30.855824 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:16:30.855824 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:16:30.855824 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:16:30.855824 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:16:30.855824 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:16:30.855824 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:16:30.855824 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:16:30.858264 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:16:30.858264 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 19:16:30.858264 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 19:16:30.858264 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 19:16:30.858264 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 19:16:30.858264 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:16:30.858264 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:16:30.858264 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:16:30.858264 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:16:30.858264 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 483630e6-3fee-46ff-8bd2-5031a27f8696 could not be found. Aug 03 19:16:30.858264 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:16:30.858264 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:16:30.858264 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:16:30.858264 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:16:30.858264 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:16:30.858264 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:16:30.858264 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:16:30.858264 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:16:30.858264 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 483630e6-3fee-46ff-8bd2-5031a27f8696 could not be found. Aug 03 19:16:30.858264 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:16:30.860978 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-609af5f0-3412-4e9f-97a1-b97f764df11c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Returning 404 to user: Instance 483630e6-3fee-46ff-8bd2-5031a27f8696 could not be found. {{(pid=118302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:16:30.860978 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-609af5f0-3412-4e9f-97a1-b97f764df11c tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "DELETE /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696" status: 404 len: 111 microversion: 2.1 time: 0.031359 Aug 03 19:16:30.860978 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 418/838] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 3 19:16:30 2022] DELETE /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:16:30.862730 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-5d73789a-1215-48e6-a442-39217386ce21 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:16:30.863403 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-5d73789a-1215-48e6-a442-39217386ce21 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] [instance: 483630e6-3fee-46ff-8bd2-5031a27f8696] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:16:30.869847 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5d73789a-1215-48e6-a442-39217386ce21 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:30.870289 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5d73789a-1215-48e6-a442-39217386ce21 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:30.871099 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5d73789a-1215-48e6-a442-39217386ce21 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:30.871536 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5d73789a-1215-48e6-a442-39217386ce21 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:30.888386 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.wsgi [None req-5d73789a-1215-48e6-a442-39217386ce21 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] HTTP exception thrown: Instance 483630e6-3fee-46ff-8bd2-5031a27f8696 could not be found. Aug 03 19:16:30.890688 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-5d73789a-1215-48e6-a442-39217386ce21 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Request method failure captured: Aug 03 19:16:30.890688 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: request: GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696 HTTP/1.1 Aug 03 19:16:30.890688 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept: application/json Aug 03 19:16:30.890688 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept-Encoding: identity Aug 03 19:16:30.890688 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Connection: close Aug 03 19:16:30.890688 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Length: 0 Aug 03 19:16:30.890688 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Type: application/json Aug 03 19:16:30.890688 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Host: 10.222.0.77 Aug 03 19:16:30.890688 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Openstack-System-Scope: None Aug 03 19:16:30.890688 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: User-Agent: python-urllib3/1.26.11 Aug 03 19:16:30.890688 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Auth-Token: gAAAAABi6sdffadQLm_E0CMgfxe8VavQQNtbdEarH7kyUCUjHdvSPyOchPO7DzYV4pw-cc1aAp83qyPjmYENqcVFbn1Zsm30Otk2xeNjKmUa3NN7dYoxj5hOEk5rjmk5HZU01I04OW2Nw6NW3uDOY1FOzqGjBbgVXquzADEZ1oOtmyGixErsioc Aug 03 19:16:30.890688 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Id: None Aug 03 19:16:30.890688 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Name: None Aug 03 19:16:30.890688 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Identity-Status: Confirmed Aug 03 19:16:30.890688 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Is-Admin-Project: True Aug 03 19:16:30.890688 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Id: default Aug 03 19:16:30.890688 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Name: Default Aug 03 19:16:30.890688 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Id: 28d15350ea8f45b490bb080384999f4b Aug 03 19:16:30.890688 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Name: tempest-TestVolumeBootPattern-2001643055 Aug 03 19:16:30.890688 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Role: reader,member Aug 03 19:16:30.890688 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Roles: reader,member Aug 03 19:16:30.892268 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_28d15350ea8f45b490bb080384999f4b", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/28d15350ea8f45b490bb080384999f4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/28d15350ea8f45b490bb080384999f4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/28d15350ea8f45b490bb080384999f4b"}]}] Aug 03 19:16:30.892268 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant: tempest-TestVolumeBootPattern-2001643055 Aug 03 19:16:30.892268 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Id: 28d15350ea8f45b490bb080384999f4b Aug 03 19:16:30.892268 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Name: tempest-TestVolumeBootPattern-2001643055 Aug 03 19:16:30.892268 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User: tempest-TestVolumeBootPattern-2001643055-project Aug 03 19:16:30.892268 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Id: default Aug 03 19:16:30.892268 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Name: Default Aug 03 19:16:30.892268 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Id: 626fe64980ed40d4bbb829c75dc0067c Aug 03 19:16:30.892268 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Name: tempest-TestVolumeBootPattern-2001643055-project Aug 03 19:16:30.892268 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: method: > Aug 03 19:16:30.892268 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: exception: Instance 483630e6-3fee-46ff-8bd2-5031a27f8696 could not be found. Aug 03 19:16:30.892268 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: action_args: {'id': '483630e6-3fee-46ff-8bd2-5031a27f8696'} Aug 03 19:16:30.893162 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:16:30.893162 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:16:30.893162 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:16:30.893162 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:16:30.893162 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:16:30.893162 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:16:30.893162 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:16:30.893162 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:16:30.893162 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:16:30.893162 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:16:30.893162 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 483630e6-3fee-46ff-8bd2-5031a27f8696 could not be found. Aug 03 19:16:30.893162 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:16:30.893162 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:16:30.893162 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:16:30.893162 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:16:30.893162 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:16:30.893162 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:16:30.893162 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:16:30.893162 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:16:30.893162 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:16:30.894601 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:16:30.894601 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:16:30.894601 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:16:30.894601 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:16:30.894601 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:16:30.894601 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:16:30.894601 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:16:30.894601 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 483630e6-3fee-46ff-8bd2-5031a27f8696 could not be found. Aug 03 19:16:30.894601 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:16:30.894601 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:16:30.894601 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:16:30.894601 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:16:30.894601 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:16:30.894601 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:16:30.894601 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:16:30.894601 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:16:30.894601 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 483630e6-3fee-46ff-8bd2-5031a27f8696 could not be found. Aug 03 19:16:30.894601 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:16:30.899563 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-5d73789a-1215-48e6-a442-39217386ce21 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Returning 404 to user: Instance 483630e6-3fee-46ff-8bd2-5031a27f8696 could not be found. {{(pid=118303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:16:30.899563 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-5d73789a-1215-48e6-a442-39217386ce21 tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696" status: 404 len: 111 microversion: 2.1 time: 0.033304 Aug 03 19:16:30.899563 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 421/839] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:16:30 2022] GET /compute/v2.1/servers/483630e6-3fee-46ff-8bd2-5031a27f8696 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 19:16:32.464374 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-1b296e38-8af3-4eca-80a3-24029854e07b tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] Calling method '.version_select at 0x7f47861f3550>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:16:32.556645 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-1b296e38-8af3-4eca-80a3-24029854e07b tempest-TestVolumeBootPattern-2001643055 tempest-TestVolumeBootPattern-2001643055-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1132387639" status: 202 len: 0 microversion: 2.1 time: 0.096063 Aug 03 19:16:32.557234 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 419/840] 10.222.0.77 () {58 vars in 1263 bytes} [Wed Aug 3 19:16:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1132387639 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 19:16:46.548427 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:16:46.549130 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:16:46.782419 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-233ad018-a476-44d3-951b-ae1ae77cbb1d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:16:46.782939 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-233ad018-a476-44d3-951b-ae1ae77cbb1d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:16:46.789514 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-233ad018-a476-44d3-951b-ae1ae77cbb1d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:46.789952 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-233ad018-a476-44d3-951b-ae1ae77cbb1d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:46.790712 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-233ad018-a476-44d3-951b-ae1ae77cbb1d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:46.791168 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-233ad018-a476-44d3-951b-ae1ae77cbb1d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:46.814761 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-233ad018-a476-44d3-951b-ae1ae77cbb1d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2/ips" status: 200 len: 152 microversion: 2.20 time: 0.272623 Aug 03 19:16:46.815117 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 422/841] 10.222.0.77 () {60 vars in 1289 bytes} [Wed Aug 3 19:16:46 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2/ips => generated 152 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 19:16:49.989096 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:16:49.989875 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:16:49.993834 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-942f6b39-6e39-4820-b07f-19745c0a381d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:16:49.994359 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-942f6b39-6e39-4820-b07f-19745c0a381d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:16:50.001966 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-942f6b39-6e39-4820-b07f-19745c0a381d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:50.002411 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-942f6b39-6e39-4820-b07f-19745c0a381d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:50.003197 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-942f6b39-6e39-4820-b07f-19745c0a381d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:50.003630 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-942f6b39-6e39-4820-b07f-19745c0a381d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:50.026960 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.objects.instance [None req-942f6b39-6e39-4820-b07f-19745c0a381d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lazy-loading 'flavor' on Instance uuid 70e81dd2-02cb-482b-8f18-1babaf5146e2 {{(pid=118302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:16:50.931274 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-942f6b39-6e39-4820-b07f-19745c0a381d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "POST /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2/action" status: 202 len: 0 microversion: 2.20 time: 0.943373 Aug 03 19:16:50.931958 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 420/842] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 3 19:16:49 2022] POST /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2/action => generated 0 bytes in 945 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 19:16:50.942555 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-a27d7064-91d2-4061-9980-15cd853f032c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:16:50.943276 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-a27d7064-91d2-4061-9980-15cd853f032c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:16:50.952261 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a27d7064-91d2-4061-9980-15cd853f032c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:50.952774 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a27d7064-91d2-4061-9980-15cd853f032c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:50.953617 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a27d7064-91d2-4061-9980-15cd853f032c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:50.954195 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a27d7064-91d2-4061-9980-15cd853f032c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:51.098498 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-a27d7064-91d2-4061-9980-15cd853f032c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:16:51.107421 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-a27d7064-91d2-4061-9980-15cd853f032c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:16:51.113558 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-a27d7064-91d2-4061-9980-15cd853f032c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:16:51.113558 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-a27d7064-91d2-4061-9980-15cd853f032c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1724 microversion: 2.20 time: 0.173530 Aug 03 19:16:51.113558 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 423/843] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:16:50 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:16:52.135450 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-4286860b-90d3-4210-89ba-8a51e4e5c620 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:16:52.136374 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-4286860b-90d3-4210-89ba-8a51e4e5c620 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:16:52.142866 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4286860b-90d3-4210-89ba-8a51e4e5c620 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:52.143345 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4286860b-90d3-4210-89ba-8a51e4e5c620 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:52.144123 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4286860b-90d3-4210-89ba-8a51e4e5c620 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:52.144563 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4286860b-90d3-4210-89ba-8a51e4e5c620 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:52.281207 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-4286860b-90d3-4210-89ba-8a51e4e5c620 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:16:52.289456 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-4286860b-90d3-4210-89ba-8a51e4e5c620 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:16:52.290964 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-4286860b-90d3-4210-89ba-8a51e4e5c620 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:16:52.292112 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-4286860b-90d3-4210-89ba-8a51e4e5c620 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1724 microversion: 2.20 time: 0.161911 Aug 03 19:16:52.292972 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 421/844] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:16:52 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:16:53.317157 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-ed6da279-0367-4da5-af57-04885ac503b1 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:16:53.317699 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-ed6da279-0367-4da5-af57-04885ac503b1 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:16:53.324449 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ed6da279-0367-4da5-af57-04885ac503b1 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:53.324895 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ed6da279-0367-4da5-af57-04885ac503b1 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:53.325660 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ed6da279-0367-4da5-af57-04885ac503b1 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:53.326112 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ed6da279-0367-4da5-af57-04885ac503b1 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:53.468865 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-ed6da279-0367-4da5-af57-04885ac503b1 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:16:53.476998 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-ed6da279-0367-4da5-af57-04885ac503b1 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:16:53.478497 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-ed6da279-0367-4da5-af57-04885ac503b1 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:16:53.479689 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-ed6da279-0367-4da5-af57-04885ac503b1 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1724 microversion: 2.20 time: 0.166698 Aug 03 19:16:53.490903 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 424/845] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:16:53 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:16:54.504407 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-888ea16b-b6b4-42e6-bfe1-332829ae2214 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:16:54.504962 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-888ea16b-b6b4-42e6-bfe1-332829ae2214 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:16:54.512046 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-888ea16b-b6b4-42e6-bfe1-332829ae2214 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:54.512490 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-888ea16b-b6b4-42e6-bfe1-332829ae2214 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:54.513258 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-888ea16b-b6b4-42e6-bfe1-332829ae2214 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:54.514201 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-888ea16b-b6b4-42e6-bfe1-332829ae2214 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:54.652616 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-888ea16b-b6b4-42e6-bfe1-332829ae2214 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:16:54.661473 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-888ea16b-b6b4-42e6-bfe1-332829ae2214 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:16:54.663021 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-888ea16b-b6b4-42e6-bfe1-332829ae2214 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:16:54.664215 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-888ea16b-b6b4-42e6-bfe1-332829ae2214 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1724 microversion: 2.20 time: 0.163842 Aug 03 19:16:54.664771 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 422/846] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:16:54 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:16:55.688519 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-48d25db1-c8d8-4408-a60e-7d0dd34cb2ed tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:16:55.689068 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-48d25db1-c8d8-4408-a60e-7d0dd34cb2ed tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:16:55.695684 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-48d25db1-c8d8-4408-a60e-7d0dd34cb2ed tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:55.696139 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-48d25db1-c8d8-4408-a60e-7d0dd34cb2ed tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:55.696955 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-48d25db1-c8d8-4408-a60e-7d0dd34cb2ed tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:55.697403 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-48d25db1-c8d8-4408-a60e-7d0dd34cb2ed tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:55.836177 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-48d25db1-c8d8-4408-a60e-7d0dd34cb2ed tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:16:55.845018 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-48d25db1-c8d8-4408-a60e-7d0dd34cb2ed tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:16:55.846512 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-48d25db1-c8d8-4408-a60e-7d0dd34cb2ed tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:16:55.847689 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-48d25db1-c8d8-4408-a60e-7d0dd34cb2ed tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1724 microversion: 2.20 time: 0.163925 Aug 03 19:16:55.848245 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 425/847] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:16:55 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:16:56.870802 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-df43d985-4c77-4d6c-baec-d11b4fc2600c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:16:56.871405 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-df43d985-4c77-4d6c-baec-d11b4fc2600c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:16:56.878564 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-df43d985-4c77-4d6c-baec-d11b4fc2600c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:56.879052 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-df43d985-4c77-4d6c-baec-d11b4fc2600c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:56.879817 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-df43d985-4c77-4d6c-baec-d11b4fc2600c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:56.880370 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-df43d985-4c77-4d6c-baec-d11b4fc2600c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:57.026482 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-df43d985-4c77-4d6c-baec-d11b4fc2600c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:16:57.034887 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-df43d985-4c77-4d6c-baec-d11b4fc2600c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:16:57.036416 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-df43d985-4c77-4d6c-baec-d11b4fc2600c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:16:57.037573 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-df43d985-4c77-4d6c-baec-d11b4fc2600c tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1724 microversion: 2.20 time: 0.170730 Aug 03 19:16:57.038130 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 423/848] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:16:56 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:16:58.061377 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-08311cbf-4787-4029-882a-392671df467e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:16:58.062018 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-08311cbf-4787-4029-882a-392671df467e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:16:58.068774 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-08311cbf-4787-4029-882a-392671df467e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:58.069220 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-08311cbf-4787-4029-882a-392671df467e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:58.069983 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-08311cbf-4787-4029-882a-392671df467e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:58.070416 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-08311cbf-4787-4029-882a-392671df467e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:58.206914 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-08311cbf-4787-4029-882a-392671df467e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:16:58.215306 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-08311cbf-4787-4029-882a-392671df467e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:16:58.217515 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-08311cbf-4787-4029-882a-392671df467e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:16:58.218786 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-08311cbf-4787-4029-882a-392671df467e tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1724 microversion: 2.20 time: 0.161723 Aug 03 19:16:58.219377 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 426/849] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:16:58 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:16:59.242067 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-862aadf9-63ff-4bbb-ad7a-06455c1d0241 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:16:59.242616 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-862aadf9-63ff-4bbb-ad7a-06455c1d0241 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:16:59.250431 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-862aadf9-63ff-4bbb-ad7a-06455c1d0241 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:59.250887 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-862aadf9-63ff-4bbb-ad7a-06455c1d0241 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:59.252309 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-862aadf9-63ff-4bbb-ad7a-06455c1d0241 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:16:59.252309 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-862aadf9-63ff-4bbb-ad7a-06455c1d0241 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:16:59.389291 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-862aadf9-63ff-4bbb-ad7a-06455c1d0241 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:16:59.397688 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-862aadf9-63ff-4bbb-ad7a-06455c1d0241 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:16:59.399231 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-862aadf9-63ff-4bbb-ad7a-06455c1d0241 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:16:59.400462 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-862aadf9-63ff-4bbb-ad7a-06455c1d0241 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1724 microversion: 2.20 time: 0.162470 Aug 03 19:16:59.401037 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 424/850] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:16:59 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:17:00.424482 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-2cf6f4d1-8dc1-4a4c-b17b-9bcd9fb1dc8f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:17:00.425094 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-2cf6f4d1-8dc1-4a4c-b17b-9bcd9fb1dc8f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:00.431793 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2cf6f4d1-8dc1-4a4c-b17b-9bcd9fb1dc8f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:00.432249 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2cf6f4d1-8dc1-4a4c-b17b-9bcd9fb1dc8f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:00.433653 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2cf6f4d1-8dc1-4a4c-b17b-9bcd9fb1dc8f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:00.433653 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2cf6f4d1-8dc1-4a4c-b17b-9bcd9fb1dc8f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:00.570721 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-2cf6f4d1-8dc1-4a4c-b17b-9bcd9fb1dc8f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:00.579456 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-2cf6f4d1-8dc1-4a4c-b17b-9bcd9fb1dc8f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:00.581348 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-2cf6f4d1-8dc1-4a4c-b17b-9bcd9fb1dc8f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:00.582102 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-2cf6f4d1-8dc1-4a4c-b17b-9bcd9fb1dc8f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1724 microversion: 2.20 time: 0.163003 Aug 03 19:17:00.583041 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 427/851] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:17:00 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 19:17:01.605746 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-a04e2231-d97e-40bf-9176-0780099cb6cd tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:17:01.606288 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-a04e2231-d97e-40bf-9176-0780099cb6cd tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:01.613739 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a04e2231-d97e-40bf-9176-0780099cb6cd tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:01.614181 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a04e2231-d97e-40bf-9176-0780099cb6cd tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:01.614960 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a04e2231-d97e-40bf-9176-0780099cb6cd tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:01.615451 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a04e2231-d97e-40bf-9176-0780099cb6cd tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:01.752147 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-a04e2231-d97e-40bf-9176-0780099cb6cd tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:01.760113 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-a04e2231-d97e-40bf-9176-0780099cb6cd tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:01.761608 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-a04e2231-d97e-40bf-9176-0780099cb6cd tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:01.762805 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-a04e2231-d97e-40bf-9176-0780099cb6cd tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1724 microversion: 2.20 time: 0.161060 Aug 03 19:17:01.763405 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 425/852] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:17:01 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:17:02.786739 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-e916664c-3563-43af-b693-129a2abc9dd7 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:17:02.787387 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-e916664c-3563-43af-b693-129a2abc9dd7 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:02.794289 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e916664c-3563-43af-b693-129a2abc9dd7 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:02.794735 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e916664c-3563-43af-b693-129a2abc9dd7 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:02.796321 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e916664c-3563-43af-b693-129a2abc9dd7 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:02.796764 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e916664c-3563-43af-b693-129a2abc9dd7 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:02.930413 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-e916664c-3563-43af-b693-129a2abc9dd7 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:02.938615 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-e916664c-3563-43af-b693-129a2abc9dd7 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:02.940166 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-e916664c-3563-43af-b693-129a2abc9dd7 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:02.941347 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-e916664c-3563-43af-b693-129a2abc9dd7 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1745 microversion: 2.20 time: 0.158521 Aug 03 19:17:02.941904 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 428/853] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:17:02 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:17:03.963893 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-f46f43b6-8144-4170-9685-372be725c81a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:17:03.964506 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-f46f43b6-8144-4170-9685-372be725c81a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:03.971518 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f46f43b6-8144-4170-9685-372be725c81a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:03.971909 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f46f43b6-8144-4170-9685-372be725c81a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:03.972667 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f46f43b6-8144-4170-9685-372be725c81a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:03.973098 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f46f43b6-8144-4170-9685-372be725c81a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:04.106994 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-f46f43b6-8144-4170-9685-372be725c81a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:04.115887 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-f46f43b6-8144-4170-9685-372be725c81a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:04.117408 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-f46f43b6-8144-4170-9685-372be725c81a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:04.118529 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-f46f43b6-8144-4170-9685-372be725c81a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1745 microversion: 2.20 time: 0.158613 Aug 03 19:17:04.119103 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 426/854] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:17:03 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:17:05.142494 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-be6850fd-936b-4efa-ba57-05253f1fa3f0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:17:05.143149 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-be6850fd-936b-4efa-ba57-05253f1fa3f0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:05.149824 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-be6850fd-936b-4efa-ba57-05253f1fa3f0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:05.150279 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-be6850fd-936b-4efa-ba57-05253f1fa3f0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:05.151077 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-be6850fd-936b-4efa-ba57-05253f1fa3f0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:05.151540 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-be6850fd-936b-4efa-ba57-05253f1fa3f0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:05.269496 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-b4d526c1-b030-427d-96f5-17be4e4d44b7 req-f1563bed-e75b-4861-9588-5a48b08d2a93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70e81dd2-02cb-482b-8f18-1babaf5146e2", "name": "network-vif-plugged", "status": "completed", "tag": "e271ef1f-3256-47c1-9a95-0979da44d6db"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:17:05.278804 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-b4d526c1-b030-427d-96f5-17be4e4d44b7 req-f1563bed-e75b-4861-9588-5a48b08d2a93 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:05.279485 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-b4d526c1-b030-427d-96f5-17be4e4d44b7 req-f1563bed-e75b-4861-9588-5a48b08d2a93 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:05.290576 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-be6850fd-936b-4efa-ba57-05253f1fa3f0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:05.290753 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-b4d526c1-b030-427d-96f5-17be4e4d44b7 req-f1563bed-e75b-4861-9588-5a48b08d2a93 service nova] Creating event network-vif-plugged:e271ef1f-3256-47c1-9a95-0979da44d6db for instance 70e81dd2-02cb-482b-8f18-1babaf5146e2 on hv-cinder-85202 Aug 03 19:17:05.296730 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-b4d526c1-b030-427d-96f5-17be4e4d44b7 req-f1563bed-e75b-4861-9588-5a48b08d2a93 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096966 Aug 03 19:17:05.297622 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 427/855] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 19:17:05.302407 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-be6850fd-936b-4efa-ba57-05253f1fa3f0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:05.303965 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-be6850fd-936b-4efa-ba57-05253f1fa3f0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:05.305306 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-be6850fd-936b-4efa-ba57-05253f1fa3f0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1745 microversion: 2.20 time: 0.167545 Aug 03 19:17:05.306032 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 429/856] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:17:05 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:17:06.331195 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-e683fbcd-8a13-4aa2-8ff1-baead46ed8cb tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:17:06.331908 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-e683fbcd-8a13-4aa2-8ff1-baead46ed8cb tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:06.338540 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e683fbcd-8a13-4aa2-8ff1-baead46ed8cb tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:06.339017 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e683fbcd-8a13-4aa2-8ff1-baead46ed8cb tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:06.339811 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e683fbcd-8a13-4aa2-8ff1-baead46ed8cb tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:06.340251 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e683fbcd-8a13-4aa2-8ff1-baead46ed8cb tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:06.487033 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-e683fbcd-8a13-4aa2-8ff1-baead46ed8cb tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:06.495768 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-e683fbcd-8a13-4aa2-8ff1-baead46ed8cb tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:06.497377 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-e683fbcd-8a13-4aa2-8ff1-baead46ed8cb tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:06.499305 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-e683fbcd-8a13-4aa2-8ff1-baead46ed8cb tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1745 microversion: 2.20 time: 0.173631 Aug 03 19:17:06.499930 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 428/857] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:17:06 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1745 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:17:07.522980 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-3d845143-314d-459a-93cc-2fd3c62461cc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:17:07.523576 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-3d845143-314d-459a-93cc-2fd3c62461cc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:07.530412 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3d845143-314d-459a-93cc-2fd3c62461cc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:07.530854 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3d845143-314d-459a-93cc-2fd3c62461cc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:07.531652 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3d845143-314d-459a-93cc-2fd3c62461cc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:07.532082 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3d845143-314d-459a-93cc-2fd3c62461cc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:07.666507 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-3d845143-314d-459a-93cc-2fd3c62461cc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:07.676147 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-3d845143-314d-459a-93cc-2fd3c62461cc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:07.677671 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-3d845143-314d-459a-93cc-2fd3c62461cc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:07.678842 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-3d845143-314d-459a-93cc-2fd3c62461cc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1745 microversion: 2.20 time: 0.159804 Aug 03 19:17:07.679451 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 430/858] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:17:07 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:17:08.702255 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-11d643bb-a7b6-44db-a2b8-47f22c6212a5 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:17:08.704068 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-11d643bb-a7b6-44db-a2b8-47f22c6212a5 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:08.709926 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-11d643bb-a7b6-44db-a2b8-47f22c6212a5 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:08.710802 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-11d643bb-a7b6-44db-a2b8-47f22c6212a5 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:08.712094 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-11d643bb-a7b6-44db-a2b8-47f22c6212a5 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:08.712915 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-11d643bb-a7b6-44db-a2b8-47f22c6212a5 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:08.891697 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-11d643bb-a7b6-44db-a2b8-47f22c6212a5 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:08.900792 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-11d643bb-a7b6-44db-a2b8-47f22c6212a5 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:08.902409 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-11d643bb-a7b6-44db-a2b8-47f22c6212a5 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:08.903745 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-11d643bb-a7b6-44db-a2b8-47f22c6212a5 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1740 microversion: 2.20 time: 0.205628 Aug 03 19:17:08.905193 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 429/859] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:17:08 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1740 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:17:09.934031 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-009eadc9-daf9-47c2-9950-9b3674767143 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:17:09.934838 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-009eadc9-daf9-47c2-9950-9b3674767143 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:09.941769 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-009eadc9-daf9-47c2-9950-9b3674767143 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:09.942652 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-009eadc9-daf9-47c2-9950-9b3674767143 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:09.943823 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-009eadc9-daf9-47c2-9950-9b3674767143 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:09.945197 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-009eadc9-daf9-47c2-9950-9b3674767143 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:10.105954 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-009eadc9-daf9-47c2-9950-9b3674767143 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:10.116754 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-009eadc9-daf9-47c2-9950-9b3674767143 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:10.118402 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-009eadc9-daf9-47c2-9950-9b3674767143 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:10.119830 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-009eadc9-daf9-47c2-9950-9b3674767143 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1740 microversion: 2.20 time: 0.190206 Aug 03 19:17:10.135553 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 431/860] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:17:09 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1740 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:17:11.145268 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-5882b8f6-e745-4370-af48-5debc8b5cc56 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:17:11.146141 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-5882b8f6-e745-4370-af48-5debc8b5cc56 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:11.153381 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-5882b8f6-e745-4370-af48-5debc8b5cc56 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:11.153828 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-5882b8f6-e745-4370-af48-5debc8b5cc56 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:11.155661 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-5882b8f6-e745-4370-af48-5debc8b5cc56 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:11.156326 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-5882b8f6-e745-4370-af48-5debc8b5cc56 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:11.312935 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-5882b8f6-e745-4370-af48-5debc8b5cc56 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:11.322128 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-5882b8f6-e745-4370-af48-5debc8b5cc56 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:11.323698 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-5882b8f6-e745-4370-af48-5debc8b5cc56 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:11.324842 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-5882b8f6-e745-4370-af48-5debc8b5cc56 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1740 microversion: 2.20 time: 0.183670 Aug 03 19:17:11.325400 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 430/861] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:17:11 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:17:12.356047 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-79cf7e53-be89-4b09-9741-502863728464 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:17:12.358075 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-79cf7e53-be89-4b09-9741-502863728464 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:12.366668 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-79cf7e53-be89-4b09-9741-502863728464 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:12.367536 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-79cf7e53-be89-4b09-9741-502863728464 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:12.368881 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-79cf7e53-be89-4b09-9741-502863728464 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:12.369741 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-79cf7e53-be89-4b09-9741-502863728464 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:12.566427 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-79cf7e53-be89-4b09-9741-502863728464 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:12.577370 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-79cf7e53-be89-4b09-9741-502863728464 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:12.579627 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-79cf7e53-be89-4b09-9741-502863728464 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:12.581087 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-79cf7e53-be89-4b09-9741-502863728464 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1740 microversion: 2.20 time: 0.229017 Aug 03 19:17:12.581937 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 432/862] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:17:12 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1740 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:17:13.606916 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-d670dd7d-cc98-4041-abf9-36088d3f7a10 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:17:13.607754 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-d670dd7d-cc98-4041-abf9-36088d3f7a10 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:13.615263 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d670dd7d-cc98-4041-abf9-36088d3f7a10 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:13.615973 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d670dd7d-cc98-4041-abf9-36088d3f7a10 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:13.616764 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d670dd7d-cc98-4041-abf9-36088d3f7a10 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:13.617199 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d670dd7d-cc98-4041-abf9-36088d3f7a10 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:13.943500 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-d670dd7d-cc98-4041-abf9-36088d3f7a10 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:13.955535 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-d670dd7d-cc98-4041-abf9-36088d3f7a10 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:13.957036 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-d670dd7d-cc98-4041-abf9-36088d3f7a10 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:13.958196 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-d670dd7d-cc98-4041-abf9-36088d3f7a10 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1740 microversion: 2.20 time: 0.355927 Aug 03 19:17:13.958746 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 431/863] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:17:13 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1740 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:17:14.985689 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-1ce8bacd-551e-431b-b025-2ce2f83e74ef tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:17:14.986483 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-1ce8bacd-551e-431b-b025-2ce2f83e74ef tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:14.994338 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1ce8bacd-551e-431b-b025-2ce2f83e74ef tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:14.994792 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1ce8bacd-551e-431b-b025-2ce2f83e74ef tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:14.995813 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1ce8bacd-551e-431b-b025-2ce2f83e74ef tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:14.996490 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1ce8bacd-551e-431b-b025-2ce2f83e74ef tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:15.161103 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-1ce8bacd-551e-431b-b025-2ce2f83e74ef tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:15.172109 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-1ce8bacd-551e-431b-b025-2ce2f83e74ef tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:15.174054 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-1ce8bacd-551e-431b-b025-2ce2f83e74ef tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:15.175355 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-1ce8bacd-551e-431b-b025-2ce2f83e74ef tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1740 microversion: 2.20 time: 0.194340 Aug 03 19:17:15.187720 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 433/864] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:17:14 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1740 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:17:16.200045 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-812f55f9-557e-4b9e-867a-862b21f9ce07 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:17:16.202130 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-812f55f9-557e-4b9e-867a-862b21f9ce07 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:16.208794 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-812f55f9-557e-4b9e-867a-862b21f9ce07 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:16.209581 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-812f55f9-557e-4b9e-867a-862b21f9ce07 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:16.210440 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-812f55f9-557e-4b9e-867a-862b21f9ce07 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:16.211001 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-812f55f9-557e-4b9e-867a-862b21f9ce07 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:16.392047 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-812f55f9-557e-4b9e-867a-862b21f9ce07 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:16.401472 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-812f55f9-557e-4b9e-867a-862b21f9ce07 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:16.403348 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-812f55f9-557e-4b9e-867a-862b21f9ce07 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:16.406016 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-812f55f9-557e-4b9e-867a-862b21f9ce07 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1740 microversion: 2.20 time: 0.210445 Aug 03 19:17:16.424291 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 432/865] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:17:16 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1740 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:17:17.433852 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-51b2709b-c4f9-4b32-81bd-d4e6f721f895 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:17:17.433852 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-51b2709b-c4f9-4b32-81bd-d4e6f721f895 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:17.439447 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_api:SELECT=25 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:17:17.442178 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-51b2709b-c4f9-4b32-81bd-d4e6f721f895 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:17.442617 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-51b2709b-c4f9-4b32-81bd-d4e6f721f895 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:17.443580 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-51b2709b-c4f9-4b32-81bd-d4e6f721f895 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:17.444013 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-51b2709b-c4f9-4b32-81bd-d4e6f721f895 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:17.604453 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-51b2709b-c4f9-4b32-81bd-d4e6f721f895 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:17.613423 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-51b2709b-c4f9-4b32-81bd-d4e6f721f895 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:17.615946 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-51b2709b-c4f9-4b32-81bd-d4e6f721f895 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:17.616944 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-51b2709b-c4f9-4b32-81bd-d4e6f721f895 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1740 microversion: 2.20 time: 0.187080 Aug 03 19:17:17.617303 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 434/866] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:17:17 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:17:18.640616 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-1a72fedc-a01f-475d-8de3-f50fae58b204 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:17:18.641268 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-1a72fedc-a01f-475d-8de3-f50fae58b204 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:18.649680 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1a72fedc-a01f-475d-8de3-f50fae58b204 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:18.650217 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1a72fedc-a01f-475d-8de3-f50fae58b204 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:18.651055 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1a72fedc-a01f-475d-8de3-f50fae58b204 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:18.651886 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1a72fedc-a01f-475d-8de3-f50fae58b204 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:18.800814 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-1a72fedc-a01f-475d-8de3-f50fae58b204 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:18.809333 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-1a72fedc-a01f-475d-8de3-f50fae58b204 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:18.811488 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-1a72fedc-a01f-475d-8de3-f50fae58b204 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:18.812750 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-1a72fedc-a01f-475d-8de3-f50fae58b204 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1740 microversion: 2.20 time: 0.176158 Aug 03 19:17:18.813297 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 433/867] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:17:18 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:17:19.836096 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-8c93d1c5-ebc2-494a-8642-a6e04913b71f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:17:19.836921 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-8c93d1c5-ebc2-494a-8642-a6e04913b71f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:19.843819 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8c93d1c5-ebc2-494a-8642-a6e04913b71f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:19.844275 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8c93d1c5-ebc2-494a-8642-a6e04913b71f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:19.845049 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8c93d1c5-ebc2-494a-8642-a6e04913b71f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:19.845485 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8c93d1c5-ebc2-494a-8642-a6e04913b71f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:19.994851 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-8c93d1c5-ebc2-494a-8642-a6e04913b71f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:20.004266 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-8c93d1c5-ebc2-494a-8642-a6e04913b71f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:20.005781 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-8c93d1c5-ebc2-494a-8642-a6e04913b71f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:20.007005 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-8c93d1c5-ebc2-494a-8642-a6e04913b71f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1722 microversion: 2.20 time: 0.174892 Aug 03 19:17:20.007772 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 435/868] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:17:19 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:17:21.030959 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-0c7fcfee-f59d-4a66-a107-2517485ceb9d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:17:21.031623 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-0c7fcfee-f59d-4a66-a107-2517485ceb9d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:21.034068 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_api:SELECT=29 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:17:21.038822 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0c7fcfee-f59d-4a66-a107-2517485ceb9d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:21.039300 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0c7fcfee-f59d-4a66-a107-2517485ceb9d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:21.040072 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0c7fcfee-f59d-4a66-a107-2517485ceb9d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:21.040505 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0c7fcfee-f59d-4a66-a107-2517485ceb9d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:21.043342 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:17:21.184279 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-0c7fcfee-f59d-4a66-a107-2517485ceb9d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:21.193702 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-0c7fcfee-f59d-4a66-a107-2517485ceb9d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:21.195260 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-0c7fcfee-f59d-4a66-a107-2517485ceb9d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:21.196415 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-0c7fcfee-f59d-4a66-a107-2517485ceb9d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1722 microversion: 2.20 time: 0.170031 Aug 03 19:17:21.196960 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 434/869] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:17:21 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:17:22.219164 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-143ba649-dc92-4c12-89ef-db8a6cedc511 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:17:22.219798 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-143ba649-dc92-4c12-89ef-db8a6cedc511 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:22.226374 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-143ba649-dc92-4c12-89ef-db8a6cedc511 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:22.226905 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-143ba649-dc92-4c12-89ef-db8a6cedc511 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:22.227721 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-143ba649-dc92-4c12-89ef-db8a6cedc511 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:22.228152 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-143ba649-dc92-4c12-89ef-db8a6cedc511 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:22.230718 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=83 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:17:22.367446 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-143ba649-dc92-4c12-89ef-db8a6cedc511 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:22.378918 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-143ba649-dc92-4c12-89ef-db8a6cedc511 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:22.380864 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-143ba649-dc92-4c12-89ef-db8a6cedc511 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:22.382097 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-143ba649-dc92-4c12-89ef-db8a6cedc511 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1725 microversion: 2.20 time: 0.167788 Aug 03 19:17:22.382662 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 436/870] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:17:22 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:17:22.405169 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-fb66b41f-667c-48ad-ba1f-65ecda761321 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "180b8b94-597b-4609-86a7-d9b4ff2135c5"}} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:17:22.407602 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-fb66b41f-667c-48ad-ba1f-65ecda761321 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:22.414191 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fb66b41f-667c-48ad-ba1f-65ecda761321 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:22.414642 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fb66b41f-667c-48ad-ba1f-65ecda761321 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:22.415447 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fb66b41f-667c-48ad-ba1f-65ecda761321 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:22.415884 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fb66b41f-667c-48ad-ba1f-65ecda761321 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:23.294004 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [req-d4c401f4-77dd-4ce3-a9cf-bb58150667a6 req-25323836-4249-4ea7-b453-40d3fbb72fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70e81dd2-02cb-482b-8f18-1babaf5146e2", "name": "network-vif-unplugged", "status": "completed", "tag": "e271ef1f-3256-47c1-9a95-0979da44d6db"}]} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:17:23.305639 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-d4c401f4-77dd-4ce3-a9cf-bb58150667a6 req-25323836-4249-4ea7-b453-40d3fbb72fc4 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:23.306081 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-d4c401f4-77dd-4ce3-a9cf-bb58150667a6 req-25323836-4249-4ea7-b453-40d3fbb72fc4 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:23.318897 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.compute.server_external_events [req-d4c401f4-77dd-4ce3-a9cf-bb58150667a6 req-25323836-4249-4ea7-b453-40d3fbb72fc4 service nova] Unable to find a host for instance 70e81dd2-02cb-482b-8f18-1babaf5146e2. Dropping event network-vif-unplugged {{(pid=118303) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 03 19:17:23.319814 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [req-d4c401f4-77dd-4ce3-a9cf-bb58150667a6 req-25323836-4249-4ea7-b453-40d3fbb72fc4 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033700 Aug 03 19:17:23.320425 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 437/871] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 03 19:17:23.620186 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-fb66b41f-667c-48ad-ba1f-65ecda761321 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "POST /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.219166 Aug 03 19:17:23.620985 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 435/872] 10.222.0.77 () {62 vars in 1364 bytes} [Wed Aug 3 19:17:22 2022] POST /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2/os-volume_attachments => generated 188 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 19:17:23.752468 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-a7ba6dbd-017d-4773-9bea-576a33ff927a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:17:23.752956 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-a7ba6dbd-017d-4773-9bea-576a33ff927a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:23.759801 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a7ba6dbd-017d-4773-9bea-576a33ff927a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:23.760246 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a7ba6dbd-017d-4773-9bea-576a33ff927a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:23.761015 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a7ba6dbd-017d-4773-9bea-576a33ff927a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:23.761461 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a7ba6dbd-017d-4773-9bea-576a33ff927a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:24.396635 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-a7ba6dbd-017d-4773-9bea-576a33ff927a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "DELETE /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2/os-volume_attachments/180b8b94-597b-4609-86a7-d9b4ff2135c5" status: 202 len: 0 microversion: 2.20 time: 0.648367 Aug 03 19:17:24.405389 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 438/873] 10.222.0.77 () {60 vars in 1457 bytes} [Wed Aug 3 19:17:23 2022] DELETE /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2/os-volume_attachments/180b8b94-597b-4609-86a7-d9b4ff2135c5 => generated 0 bytes in 650 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 19:17:24.458199 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-c01db158-c648-4d82-b1c7-98b48448b098 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:17:24.458787 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-c01db158-c648-4d82-b1c7-98b48448b098 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:24.465493 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c01db158-c648-4d82-b1c7-98b48448b098 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:24.465944 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c01db158-c648-4d82-b1c7-98b48448b098 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:24.467451 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c01db158-c648-4d82-b1c7-98b48448b098 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:24.467955 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c01db158-c648-4d82-b1c7-98b48448b098 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:24.497813 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-c01db158-c648-4d82-b1c7-98b48448b098 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118302) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 03 19:17:24.806318 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-c01db158-c648-4d82-b1c7-98b48448b098 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "POST /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2/action" status: 202 len: 0 microversion: 2.20 time: 0.352121 Aug 03 19:17:24.807002 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 436/874] 10.222.0.77 () {62 vars in 1319 bytes} [Wed Aug 3 19:17:24 2022] POST /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 19:17:24.815763 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-08a9309d-284b-4113-8daa-6c63446bfe50 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:17:24.816370 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-08a9309d-284b-4113-8daa-6c63446bfe50 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:24.823153 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-08a9309d-284b-4113-8daa-6c63446bfe50 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:24.823736 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-08a9309d-284b-4113-8daa-6c63446bfe50 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:24.824658 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-08a9309d-284b-4113-8daa-6c63446bfe50 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:24.825245 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-08a9309d-284b-4113-8daa-6c63446bfe50 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:24.963778 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-08a9309d-284b-4113-8daa-6c63446bfe50 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:24.973199 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-08a9309d-284b-4113-8daa-6c63446bfe50 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:24.974711 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-08a9309d-284b-4113-8daa-6c63446bfe50 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:24.975935 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-08a9309d-284b-4113-8daa-6c63446bfe50 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1673 microversion: 2.20 time: 0.164225 Aug 03 19:17:24.976491 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 439/875] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:17:24 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 19:17:25.999540 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-2669a47a-f428-467f-bfe0-36c75bee3060 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:17:26.000138 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-2669a47a-f428-467f-bfe0-36c75bee3060 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:26.012783 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2669a47a-f428-467f-bfe0-36c75bee3060 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:26.013233 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2669a47a-f428-467f-bfe0-36c75bee3060 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:26.014069 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2669a47a-f428-467f-bfe0-36c75bee3060 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:26.014504 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2669a47a-f428-467f-bfe0-36c75bee3060 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:26.163767 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-2669a47a-f428-467f-bfe0-36c75bee3060 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:26.173451 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-2669a47a-f428-467f-bfe0-36c75bee3060 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:26.175234 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-2669a47a-f428-467f-bfe0-36c75bee3060 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:26.176499 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-2669a47a-f428-467f-bfe0-36c75bee3060 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1673 microversion: 2.20 time: 0.181685 Aug 03 19:17:26.177056 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 437/876] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:17:25 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1673 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:17:27.199953 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-8a28e119-557a-4a58-bdb6-9b877cfd6d25 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:17:27.200582 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-8a28e119-557a-4a58-bdb6-9b877cfd6d25 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:27.207683 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8a28e119-557a-4a58-bdb6-9b877cfd6d25 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:27.208137 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8a28e119-557a-4a58-bdb6-9b877cfd6d25 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:27.208911 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8a28e119-557a-4a58-bdb6-9b877cfd6d25 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:27.209351 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8a28e119-557a-4a58-bdb6-9b877cfd6d25 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:27.348298 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-8a28e119-557a-4a58-bdb6-9b877cfd6d25 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:27.356989 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-8a28e119-557a-4a58-bdb6-9b877cfd6d25 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:27.359346 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-8a28e119-557a-4a58-bdb6-9b877cfd6d25 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:27.360562 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-8a28e119-557a-4a58-bdb6-9b877cfd6d25 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1731 microversion: 2.20 time: 0.164635 Aug 03 19:17:27.361117 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 440/877] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:17:27 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 19:17:28.383968 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-800c78fa-1023-42b9-bea9-050628b2a4c3 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:17:28.384562 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-800c78fa-1023-42b9-bea9-050628b2a4c3 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:28.395640 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-800c78fa-1023-42b9-bea9-050628b2a4c3 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:28.396097 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-800c78fa-1023-42b9-bea9-050628b2a4c3 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:28.396905 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-800c78fa-1023-42b9-bea9-050628b2a4c3 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:28.397371 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-800c78fa-1023-42b9-bea9-050628b2a4c3 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:28.599610 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-800c78fa-1023-42b9-bea9-050628b2a4c3 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:28.614901 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-800c78fa-1023-42b9-bea9-050628b2a4c3 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:28.617476 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-800c78fa-1023-42b9-bea9-050628b2a4c3 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:28.619232 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-800c78fa-1023-42b9-bea9-050628b2a4c3 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1731 microversion: 2.20 time: 0.239228 Aug 03 19:17:28.620699 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 438/878] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:17:28 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1731 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:17:29.644447 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-6cab5a43-f9d9-405b-99fa-f9cd6c458cb8 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:17:29.645169 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-6cab5a43-f9d9-405b-99fa-f9cd6c458cb8 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:29.652333 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6cab5a43-f9d9-405b-99fa-f9cd6c458cb8 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:29.652785 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6cab5a43-f9d9-405b-99fa-f9cd6c458cb8 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:29.653990 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6cab5a43-f9d9-405b-99fa-f9cd6c458cb8 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:29.653990 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6cab5a43-f9d9-405b-99fa-f9cd6c458cb8 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:29.813125 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-6cab5a43-f9d9-405b-99fa-f9cd6c458cb8 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:29.821450 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-6cab5a43-f9d9-405b-99fa-f9cd6c458cb8 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:29.823055 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-6cab5a43-f9d9-405b-99fa-f9cd6c458cb8 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:29.824244 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-6cab5a43-f9d9-405b-99fa-f9cd6c458cb8 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1731 microversion: 2.20 time: 0.183991 Aug 03 19:17:29.824994 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 441/879] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:17:29 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 19:17:30.849744 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-c9afaed9-bd7e-42c5-b140-fb9bbd3d8387 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:17:30.851931 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-c9afaed9-bd7e-42c5-b140-fb9bbd3d8387 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:30.860030 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c9afaed9-bd7e-42c5-b140-fb9bbd3d8387 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:30.860842 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c9afaed9-bd7e-42c5-b140-fb9bbd3d8387 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:30.862261 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c9afaed9-bd7e-42c5-b140-fb9bbd3d8387 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:30.862705 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c9afaed9-bd7e-42c5-b140-fb9bbd3d8387 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:31.019454 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-c9afaed9-bd7e-42c5-b140-fb9bbd3d8387 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:31.031579 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-c9afaed9-bd7e-42c5-b140-fb9bbd3d8387 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:31.033569 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-c9afaed9-bd7e-42c5-b140-fb9bbd3d8387 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:31.035386 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-c9afaed9-bd7e-42c5-b140-fb9bbd3d8387 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1731 microversion: 2.20 time: 0.189676 Aug 03 19:17:31.036251 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 439/880] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:17:30 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1731 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 19:17:32.059374 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-85ee3f64-d68f-44a7-902f-9b4dba3030eb tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:17:32.060001 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-85ee3f64-d68f-44a7-902f-9b4dba3030eb tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:32.067281 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-85ee3f64-d68f-44a7-902f-9b4dba3030eb tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:32.068038 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-85ee3f64-d68f-44a7-902f-9b4dba3030eb tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:32.068824 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-85ee3f64-d68f-44a7-902f-9b4dba3030eb tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:32.069268 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-85ee3f64-d68f-44a7-902f-9b4dba3030eb tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:32.223892 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-85ee3f64-d68f-44a7-902f-9b4dba3030eb tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:32.233378 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-85ee3f64-d68f-44a7-902f-9b4dba3030eb tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:32.235717 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-85ee3f64-d68f-44a7-902f-9b4dba3030eb tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:32.237561 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-85ee3f64-d68f-44a7-902f-9b4dba3030eb tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1731 microversion: 2.20 time: 0.181993 Aug 03 19:17:32.251283 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 442/881] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:17:32 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1731 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:17:33.264443 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-b56960d0-54cf-443e-b550-26b167bdc556 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:17:33.265619 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-b56960d0-54cf-443e-b550-26b167bdc556 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:33.273511 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b56960d0-54cf-443e-b550-26b167bdc556 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:33.273899 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b56960d0-54cf-443e-b550-26b167bdc556 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:33.274710 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b56960d0-54cf-443e-b550-26b167bdc556 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:33.275225 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b56960d0-54cf-443e-b550-26b167bdc556 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:33.461428 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-b56960d0-54cf-443e-b550-26b167bdc556 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:33.475118 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-b56960d0-54cf-443e-b550-26b167bdc556 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:33.477347 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-b56960d0-54cf-443e-b550-26b167bdc556 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:33.478325 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-b56960d0-54cf-443e-b550-26b167bdc556 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1731 microversion: 2.20 time: 0.219792 Aug 03 19:17:33.479196 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 440/882] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:17:33 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1731 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 19:17:34.503987 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-fe16910d-3f2e-4267-8c37-623de4509b6a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:17:34.505061 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-fe16910d-3f2e-4267-8c37-623de4509b6a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:34.512253 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fe16910d-3f2e-4267-8c37-623de4509b6a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:34.512679 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fe16910d-3f2e-4267-8c37-623de4509b6a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:34.513984 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fe16910d-3f2e-4267-8c37-623de4509b6a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:34.514736 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fe16910d-3f2e-4267-8c37-623de4509b6a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:34.687544 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-fe16910d-3f2e-4267-8c37-623de4509b6a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:34.703939 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-fe16910d-3f2e-4267-8c37-623de4509b6a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:34.707459 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-fe16910d-3f2e-4267-8c37-623de4509b6a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:34.709354 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-fe16910d-3f2e-4267-8c37-623de4509b6a tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1731 microversion: 2.20 time: 0.209696 Aug 03 19:17:34.710033 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 443/883] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:17:34 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1731 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 19:17:35.733833 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-0114d541-fae8-4ee4-8e96-4668b1e688e4 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:17:35.734443 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-0114d541-fae8-4ee4-8e96-4668b1e688e4 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:35.741316 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0114d541-fae8-4ee4-8e96-4668b1e688e4 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:35.741766 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0114d541-fae8-4ee4-8e96-4668b1e688e4 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:35.742548 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0114d541-fae8-4ee4-8e96-4668b1e688e4 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:35.743006 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0114d541-fae8-4ee4-8e96-4668b1e688e4 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:35.911620 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-0114d541-fae8-4ee4-8e96-4668b1e688e4 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:35.921323 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-0114d541-fae8-4ee4-8e96-4668b1e688e4 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:35.928665 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-0114d541-fae8-4ee4-8e96-4668b1e688e4 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:35.932105 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-0114d541-fae8-4ee4-8e96-4668b1e688e4 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1731 microversion: 2.20 time: 0.201853 Aug 03 19:17:35.941161 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 441/884] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:17:35 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1731 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:17:36.959047 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-14015b7a-207f-4d41-bd58-79b5e6b1ce6b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:17:36.959663 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-14015b7a-207f-4d41-bd58-79b5e6b1ce6b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:36.966276 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-14015b7a-207f-4d41-bd58-79b5e6b1ce6b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:36.967390 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-14015b7a-207f-4d41-bd58-79b5e6b1ce6b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:36.968163 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-14015b7a-207f-4d41-bd58-79b5e6b1ce6b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:36.968600 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-14015b7a-207f-4d41-bd58-79b5e6b1ce6b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:37.098104 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-14015b7a-207f-4d41-bd58-79b5e6b1ce6b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:37.105995 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-14015b7a-207f-4d41-bd58-79b5e6b1ce6b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:37.108133 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-14015b7a-207f-4d41-bd58-79b5e6b1ce6b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:37.109422 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-14015b7a-207f-4d41-bd58-79b5e6b1ce6b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1731 microversion: 2.20 time: 0.154342 Aug 03 19:17:37.109984 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 444/885] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:17:36 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:17:38.132208 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-e8969b8c-0be7-4aca-b96a-5f2796eda6d3 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:17:38.132787 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-e8969b8c-0be7-4aca-b96a-5f2796eda6d3 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:38.139611 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e8969b8c-0be7-4aca-b96a-5f2796eda6d3 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:38.140055 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e8969b8c-0be7-4aca-b96a-5f2796eda6d3 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:38.140827 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e8969b8c-0be7-4aca-b96a-5f2796eda6d3 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:38.141263 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e8969b8c-0be7-4aca-b96a-5f2796eda6d3 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:38.273016 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-e8969b8c-0be7-4aca-b96a-5f2796eda6d3 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:38.281157 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-e8969b8c-0be7-4aca-b96a-5f2796eda6d3 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:38.282665 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-e8969b8c-0be7-4aca-b96a-5f2796eda6d3 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:38.283983 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-e8969b8c-0be7-4aca-b96a-5f2796eda6d3 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1731 microversion: 2.20 time: 0.155750 Aug 03 19:17:38.284536 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 442/886] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:17:38 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:17:39.310695 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-018f10a4-060e-4f20-b92c-782e970d195d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:17:39.311262 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-018f10a4-060e-4f20-b92c-782e970d195d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:39.317405 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-018f10a4-060e-4f20-b92c-782e970d195d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:39.317854 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-018f10a4-060e-4f20-b92c-782e970d195d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:39.318633 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-018f10a4-060e-4f20-b92c-782e970d195d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:39.319092 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-018f10a4-060e-4f20-b92c-782e970d195d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:39.460100 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-018f10a4-060e-4f20-b92c-782e970d195d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:39.472404 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-018f10a4-060e-4f20-b92c-782e970d195d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:39.473922 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-018f10a4-060e-4f20-b92c-782e970d195d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:39.475127 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-018f10a4-060e-4f20-b92c-782e970d195d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1731 microversion: 2.20 time: 0.169061 Aug 03 19:17:39.480577 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 445/887] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:17:39 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:17:40.499808 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-2eaafe3b-9ffa-4e34-8ff7-225dc55c50d0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:17:40.499808 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-2eaafe3b-9ffa-4e34-8ff7-225dc55c50d0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:40.506348 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2eaafe3b-9ffa-4e34-8ff7-225dc55c50d0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:40.506741 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2eaafe3b-9ffa-4e34-8ff7-225dc55c50d0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:40.507548 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2eaafe3b-9ffa-4e34-8ff7-225dc55c50d0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:40.507993 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2eaafe3b-9ffa-4e34-8ff7-225dc55c50d0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:40.652978 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-2eaafe3b-9ffa-4e34-8ff7-225dc55c50d0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:40.660951 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-2eaafe3b-9ffa-4e34-8ff7-225dc55c50d0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:40.662443 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-2eaafe3b-9ffa-4e34-8ff7-225dc55c50d0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:40.663618 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-2eaafe3b-9ffa-4e34-8ff7-225dc55c50d0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1731 microversion: 2.20 time: 0.169094 Aug 03 19:17:40.664182 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 443/888] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:17:40 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:17:41.686994 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-26ea508a-5ed9-49f1-b85e-26fd6c803794 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:17:41.687617 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-26ea508a-5ed9-49f1-b85e-26fd6c803794 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:41.694130 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-26ea508a-5ed9-49f1-b85e-26fd6c803794 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:41.694583 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-26ea508a-5ed9-49f1-b85e-26fd6c803794 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:41.695381 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-26ea508a-5ed9-49f1-b85e-26fd6c803794 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:41.695828 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-26ea508a-5ed9-49f1-b85e-26fd6c803794 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:41.829947 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-26ea508a-5ed9-49f1-b85e-26fd6c803794 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:41.838064 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-26ea508a-5ed9-49f1-b85e-26fd6c803794 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:41.839603 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-26ea508a-5ed9-49f1-b85e-26fd6c803794 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:41.840752 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-26ea508a-5ed9-49f1-b85e-26fd6c803794 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1731 microversion: 2.20 time: 0.158460 Aug 03 19:17:41.841315 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 446/889] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:17:41 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 19:17:42.865057 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-e2d0707b-ba6a-4e1f-842e-c1d5bd8937b6 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:17:42.865653 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-e2d0707b-ba6a-4e1f-842e-c1d5bd8937b6 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:42.872249 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e2d0707b-ba6a-4e1f-842e-c1d5bd8937b6 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:42.873352 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e2d0707b-ba6a-4e1f-842e-c1d5bd8937b6 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:42.874127 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e2d0707b-ba6a-4e1f-842e-c1d5bd8937b6 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:42.874569 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e2d0707b-ba6a-4e1f-842e-c1d5bd8937b6 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:43.008608 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-e2d0707b-ba6a-4e1f-842e-c1d5bd8937b6 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:43.016840 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-e2d0707b-ba6a-4e1f-842e-c1d5bd8937b6 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:43.018380 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-e2d0707b-ba6a-4e1f-842e-c1d5bd8937b6 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:43.019656 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-e2d0707b-ba6a-4e1f-842e-c1d5bd8937b6 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1731 microversion: 2.20 time: 0.158536 Aug 03 19:17:43.020275 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 444/890] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:17:42 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:17:44.043094 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-20d66fc7-05af-4fb5-be97-b5f44a984316 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:17:44.043729 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-20d66fc7-05af-4fb5-be97-b5f44a984316 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:44.051106 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-20d66fc7-05af-4fb5-be97-b5f44a984316 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:44.051574 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-20d66fc7-05af-4fb5-be97-b5f44a984316 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:44.052353 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-20d66fc7-05af-4fb5-be97-b5f44a984316 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:44.052790 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-20d66fc7-05af-4fb5-be97-b5f44a984316 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:44.190008 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-20d66fc7-05af-4fb5-be97-b5f44a984316 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:44.197908 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-20d66fc7-05af-4fb5-be97-b5f44a984316 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:44.199424 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-20d66fc7-05af-4fb5-be97-b5f44a984316 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:44.200564 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-20d66fc7-05af-4fb5-be97-b5f44a984316 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1731 microversion: 2.20 time: 0.161438 Aug 03 19:17:44.201271 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 447/891] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:17:44 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:17:45.224078 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-7df154f8-aca5-4715-811d-e99d6eff7f30 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:17:45.224675 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-7df154f8-aca5-4715-811d-e99d6eff7f30 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:45.230978 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7df154f8-aca5-4715-811d-e99d6eff7f30 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:45.231440 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7df154f8-aca5-4715-811d-e99d6eff7f30 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:45.232351 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7df154f8-aca5-4715-811d-e99d6eff7f30 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:45.232791 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7df154f8-aca5-4715-811d-e99d6eff7f30 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:45.383452 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-7df154f8-aca5-4715-811d-e99d6eff7f30 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:45.392769 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-7df154f8-aca5-4715-811d-e99d6eff7f30 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:45.394368 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-7df154f8-aca5-4715-811d-e99d6eff7f30 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:45.395669 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-7df154f8-aca5-4715-811d-e99d6eff7f30 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1731 microversion: 2.20 time: 0.175654 Aug 03 19:17:45.396240 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 445/892] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:17:45 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:17:45.590075 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [req-ec8db438-6e85-4373-8797-6537874c3da5 req-e52a6a8a-d0b2-4659-96a8-6d56e7118654 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70e81dd2-02cb-482b-8f18-1babaf5146e2", "name": "network-vif-plugged", "status": "completed", "tag": "e271ef1f-3256-47c1-9a95-0979da44d6db"}]} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:17:45.600725 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-ec8db438-6e85-4373-8797-6537874c3da5 req-e52a6a8a-d0b2-4659-96a8-6d56e7118654 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:45.601164 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-ec8db438-6e85-4373-8797-6537874c3da5 req-e52a6a8a-d0b2-4659-96a8-6d56e7118654 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:45.612936 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.compute.server_external_events [req-ec8db438-6e85-4373-8797-6537874c3da5 req-e52a6a8a-d0b2-4659-96a8-6d56e7118654 service nova] Creating event network-vif-plugged:e271ef1f-3256-47c1-9a95-0979da44d6db for instance 70e81dd2-02cb-482b-8f18-1babaf5146e2 on hv-cinder-85202 Aug 03 19:17:45.618193 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [req-ec8db438-6e85-4373-8797-6537874c3da5 req-e52a6a8a-d0b2-4659-96a8-6d56e7118654 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033239 Aug 03 19:17:45.618772 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 448/893] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:17:46.421358 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-311af221-4523-4d2b-a086-6be668115cbc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:17:46.422070 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-311af221-4523-4d2b-a086-6be668115cbc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:46.428970 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-311af221-4523-4d2b-a086-6be668115cbc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:46.429423 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-311af221-4523-4d2b-a086-6be668115cbc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:46.430191 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-311af221-4523-4d2b-a086-6be668115cbc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:46.430632 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-311af221-4523-4d2b-a086-6be668115cbc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:46.567483 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-311af221-4523-4d2b-a086-6be668115cbc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:46.575411 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-311af221-4523-4d2b-a086-6be668115cbc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:46.577550 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-311af221-4523-4d2b-a086-6be668115cbc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:46.578717 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-311af221-4523-4d2b-a086-6be668115cbc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1731 microversion: 2.20 time: 0.162006 Aug 03 19:17:46.579325 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 446/894] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:17:46 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:17:47.603338 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-dcc5b776-fd24-431a-803e-6df438a1bcba tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:17:47.603942 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-dcc5b776-fd24-431a-803e-6df438a1bcba tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:47.605917 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_api:SELECT=30 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:17:47.611927 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-dcc5b776-fd24-431a-803e-6df438a1bcba tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:47.612377 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-dcc5b776-fd24-431a-803e-6df438a1bcba tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:47.613155 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-dcc5b776-fd24-431a-803e-6df438a1bcba tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:47.613592 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-dcc5b776-fd24-431a-803e-6df438a1bcba tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:47.753149 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-dcc5b776-fd24-431a-803e-6df438a1bcba tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:47.762049 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-dcc5b776-fd24-431a-803e-6df438a1bcba tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:47.763368 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-dcc5b776-fd24-431a-803e-6df438a1bcba tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:47.764543 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-dcc5b776-fd24-431a-803e-6df438a1bcba tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1731 microversion: 2.20 time: 0.166222 Aug 03 19:17:47.765180 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 449/895] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:17:47 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:17:48.790055 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-180533e1-2186-447d-953a-1c7ea114046d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:17:48.790693 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-180533e1-2186-447d-953a-1c7ea114046d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:48.798618 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-180533e1-2186-447d-953a-1c7ea114046d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:48.799089 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-180533e1-2186-447d-953a-1c7ea114046d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:48.800109 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-180533e1-2186-447d-953a-1c7ea114046d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:48.800681 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-180533e1-2186-447d-953a-1c7ea114046d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:48.803348 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:17:48.940793 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-180533e1-2186-447d-953a-1c7ea114046d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:48.949495 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-180533e1-2186-447d-953a-1c7ea114046d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:48.951055 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-180533e1-2186-447d-953a-1c7ea114046d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:48.952229 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-180533e1-2186-447d-953a-1c7ea114046d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1731 microversion: 2.20 time: 0.166333 Aug 03 19:17:48.952975 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 447/896] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:17:48 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:17:49.976335 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-54c790ba-d829-4b7f-b701-ee7cf648b6ca tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:17:49.976957 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-54c790ba-d829-4b7f-b701-ee7cf648b6ca tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:17:49.984977 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-54c790ba-d829-4b7f-b701-ee7cf648b6ca tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:49.985425 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-54c790ba-d829-4b7f-b701-ee7cf648b6ca tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:49.986191 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-54c790ba-d829-4b7f-b701-ee7cf648b6ca tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:17:49.986625 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-54c790ba-d829-4b7f-b701-ee7cf648b6ca tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:17:50.119118 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-54c790ba-d829-4b7f-b701-ee7cf648b6ca tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:50.127781 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-54c790ba-d829-4b7f-b701-ee7cf648b6ca tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:50.129290 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-54c790ba-d829-4b7f-b701-ee7cf648b6ca tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:17:50.130475 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-54c790ba-d829-4b7f-b701-ee7cf648b6ca tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1718 microversion: 2.20 time: 0.158167 Aug 03 19:17:50.131059 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 450/897] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:17:49 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:18:06.526334 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 19:18:06.527120 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Wed Aug 3 19:18:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 19:18:10.316186 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 19:18:10.316846 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Wed Aug 3 19:18:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 19:18:45.238464 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-bce9e046-da2a-4701-b718-33e46a9107db tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:18:45.241279 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-bce9e046-da2a-4701-b718-33e46a9107db tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:18:45.243484 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:18:45.244138 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=5 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:18:45.250275 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-bce9e046-da2a-4701-b718-33e46a9107db tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:18:45.262226 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-bce9e046-da2a-4701-b718-33e46a9107db tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:18:45.262226 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-bce9e046-da2a-4701-b718-33e46a9107db tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:18:45.262226 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-bce9e046-da2a-4701-b718-33e46a9107db tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:18:45.286783 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-bce9e046-da2a-4701-b718-33e46a9107db tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052662 Aug 03 19:18:45.290891 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 448/898] 10.222.0.77 () {60 vars in 1343 bytes} [Wed Aug 3 19:18:45 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:18:45.357395 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-66c2725d-a67c-4289-9cc5-54f377f0b20d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:18:45.358330 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-66c2725d-a67c-4289-9cc5-54f377f0b20d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:18:45.360072 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_api:SELECT=3 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:18:45.360853 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:18:45.365810 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-66c2725d-a67c-4289-9cc5-54f377f0b20d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:18:45.366255 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-66c2725d-a67c-4289-9cc5-54f377f0b20d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:18:45.367067 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-66c2725d-a67c-4289-9cc5-54f377f0b20d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:18:45.367502 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-66c2725d-a67c-4289-9cc5-54f377f0b20d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:18:45.395521 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-66c2725d-a67c-4289-9cc5-54f377f0b20d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Going to try to terminate instance {{(pid=118303) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 19:18:45.697558 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-66c2725d-a67c-4289-9cc5-54f377f0b20d tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "DELETE /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 204 len: 0 microversion: 2.20 time: 0.344442 Aug 03 19:18:45.698200 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 451/899] 10.222.0.77 () {60 vars in 1280 bytes} [Wed Aug 3 19:18:45 2022] DELETE /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 19:18:45.707547 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-10baa1bf-85e6-4921-8d1b-3c0f618a4ca7 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:18:45.708150 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-10baa1bf-85e6-4921-8d1b-3c0f618a4ca7 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:18:45.714747 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-10baa1bf-85e6-4921-8d1b-3c0f618a4ca7 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:18:45.715225 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-10baa1bf-85e6-4921-8d1b-3c0f618a4ca7 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:18:45.715996 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-10baa1bf-85e6-4921-8d1b-3c0f618a4ca7 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:18:45.716558 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-10baa1bf-85e6-4921-8d1b-3c0f618a4ca7 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:18:45.909662 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-10baa1bf-85e6-4921-8d1b-3c0f618a4ca7 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:18:45.917707 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-10baa1bf-85e6-4921-8d1b-3c0f618a4ca7 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:18:45.919832 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-10baa1bf-85e6-4921-8d1b-3c0f618a4ca7 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:18:45.921001 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-10baa1bf-85e6-4921-8d1b-3c0f618a4ca7 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1724 microversion: 2.20 time: 0.217885 Aug 03 19:18:45.921553 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 449/900] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:18:45 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:18:46.945494 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-1a2b0728-502d-4833-964f-95ecd166a09f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:18:46.946215 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-1a2b0728-502d-4833-964f-95ecd166a09f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:18:46.953996 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1a2b0728-502d-4833-964f-95ecd166a09f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:18:46.954437 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1a2b0728-502d-4833-964f-95ecd166a09f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:18:46.955225 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1a2b0728-502d-4833-964f-95ecd166a09f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:18:46.955660 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1a2b0728-502d-4833-964f-95ecd166a09f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:18:47.146669 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-1a2b0728-502d-4833-964f-95ecd166a09f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:18:47.156295 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-1a2b0728-502d-4833-964f-95ecd166a09f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:18:47.157794 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-1a2b0728-502d-4833-964f-95ecd166a09f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:18:47.159077 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-1a2b0728-502d-4833-964f-95ecd166a09f tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1724 microversion: 2.20 time: 0.217963 Aug 03 19:18:47.159837 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 452/901] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:18:46 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 19:18:48.184454 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-f02f0ce5-945b-4286-a949-d617b111d863 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:18:48.185215 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-f02f0ce5-945b-4286-a949-d617b111d863 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:18:48.193851 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f02f0ce5-945b-4286-a949-d617b111d863 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:18:48.194549 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f02f0ce5-945b-4286-a949-d617b111d863 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:18:48.195370 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f02f0ce5-945b-4286-a949-d617b111d863 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:18:48.195817 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f02f0ce5-945b-4286-a949-d617b111d863 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:18:48.270554 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-f02f0ce5-945b-4286-a949-d617b111d863 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:18:48.279918 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-f02f0ce5-945b-4286-a949-d617b111d863 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:18:48.281522 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-f02f0ce5-945b-4286-a949-d617b111d863 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:18:48.282776 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-f02f0ce5-945b-4286-a949-d617b111d863 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1656 microversion: 2.20 time: 0.102317 Aug 03 19:18:48.283431 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 450/902] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:18:48 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1656 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:18:48.355946 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [req-36cce0dd-87fc-4e33-a203-da21d390e575 req-973b0095-20a9-4374-b6b4-a1e7cc7b1242 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70e81dd2-02cb-482b-8f18-1babaf5146e2", "name": "network-vif-deleted", "tag": "e271ef1f-3256-47c1-9a95-0979da44d6db"}]} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:18:48.366256 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-36cce0dd-87fc-4e33-a203-da21d390e575 req-973b0095-20a9-4374-b6b4-a1e7cc7b1242 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:18:48.375158 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-36cce0dd-87fc-4e33-a203-da21d390e575 req-973b0095-20a9-4374-b6b4-a1e7cc7b1242 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:18:48.378965 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.compute.server_external_events [req-36cce0dd-87fc-4e33-a203-da21d390e575 req-973b0095-20a9-4374-b6b4-a1e7cc7b1242 service nova] Creating event network-vif-deleted:e271ef1f-3256-47c1-9a95-0979da44d6db for instance 70e81dd2-02cb-482b-8f18-1babaf5146e2 on hv-cinder-85202 Aug 03 19:18:48.384297 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [req-36cce0dd-87fc-4e33-a203-da21d390e575 req-973b0095-20a9-4374-b6b4-a1e7cc7b1242 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031924 Aug 03 19:18:48.385028 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 453/903] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:18:49.306174 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-f93eac54-fd3f-4f17-9aca-099c01c4d027 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:18:49.306723 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-f93eac54-fd3f-4f17-9aca-099c01c4d027 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:18:49.313954 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f93eac54-fd3f-4f17-9aca-099c01c4d027 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:18:49.314411 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f93eac54-fd3f-4f17-9aca-099c01c4d027 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:18:49.315232 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f93eac54-fd3f-4f17-9aca-099c01c4d027 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:18:49.315677 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f93eac54-fd3f-4f17-9aca-099c01c4d027 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:18:49.347569 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f93eac54-fd3f-4f17-9aca-099c01c4d027 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:18:49.348022 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f93eac54-fd3f-4f17-9aca-099c01c4d027 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:18:49.348477 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.objects.instance [None req-f93eac54-fd3f-4f17-9aca-099c01c4d027 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lazy-loading 'fault' on Instance uuid 70e81dd2-02cb-482b-8f18-1babaf5146e2 {{(pid=118302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:18:49.399662 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-f93eac54-fd3f-4f17-9aca-099c01c4d027 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:18:49.400802 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-f93eac54-fd3f-4f17-9aca-099c01c4d027 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:18:49.402326 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-f93eac54-fd3f-4f17-9aca-099c01c4d027 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ad3e2057063434a8938a6e1309782c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9177b6619c48e38c20abcda2ebadd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:18:49.403591 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-f93eac54-fd3f-4f17-9aca-099c01c4d027 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 200 len: 1371 microversion: 2.20 time: 0.101510 Aug 03 19:18:49.404153 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 451/904] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:18:49 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 1371 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:18:50.427449 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-2da38df7-efbf-4f68-ba40-c46f108fefa2 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:18:50.428154 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-2da38df7-efbf-4f68-ba40-c46f108fefa2 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:18:50.435210 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2da38df7-efbf-4f68-ba40-c46f108fefa2 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:18:50.435671 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2da38df7-efbf-4f68-ba40-c46f108fefa2 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:18:50.436488 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2da38df7-efbf-4f68-ba40-c46f108fefa2 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:18:50.436926 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2da38df7-efbf-4f68-ba40-c46f108fefa2 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:18:50.450968 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.wsgi [None req-2da38df7-efbf-4f68-ba40-c46f108fefa2 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] HTTP exception thrown: Instance 70e81dd2-02cb-482b-8f18-1babaf5146e2 could not be found. Aug 03 19:18:50.452609 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-2da38df7-efbf-4f68-ba40-c46f108fefa2 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Request method failure captured: Aug 03 19:18:50.452609 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: request: GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 HTTP/1.1 Aug 03 19:18:50.452609 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept: application/json Aug 03 19:18:50.452609 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept-Encoding: identity Aug 03 19:18:50.452609 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Connection: close Aug 03 19:18:50.452609 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Length: 0 Aug 03 19:18:50.452609 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Type: application/json Aug 03 19:18:50.452609 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Host: 10.222.0.77 Aug 03 19:18:50.452609 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Openstack-System-Scope: None Aug 03 19:18:50.452609 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: User-Agent: python-urllib3/1.26.11 Aug 03 19:18:50.452609 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Auth-Token: gAAAAABi6sgx46KEqIROZCyfP1h34-boPbWwPwd4T4Amm5Rx0Rx7moJYv2e0luuy3FqHtTHmnUgQ4o7xHrzlhTKXBRyo0ZiPWbXKR4cCBYx7LLgwlBoqsaLO8mEVikX_Hp3amqdlJtqy788Hx-BbzUBzZiKG8faaJoVotVZYD3MG0ZcVrz2bEXM Aug 03 19:18:50.452609 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Id: None Aug 03 19:18:50.452609 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Name: None Aug 03 19:18:50.452609 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Identity-Status: Confirmed Aug 03 19:18:50.452609 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Is-Admin-Project: True Aug 03 19:18:50.452609 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 19:18:50.452609 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Id: default Aug 03 19:18:50.452609 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Name: Default Aug 03 19:18:50.452609 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Id: fb9177b6619c48e38c20abcda2ebadd4 Aug 03 19:18:50.452609 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1411043165 Aug 03 19:18:50.452609 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Role: reader,member Aug 03 19:18:50.452609 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Roles: reader,member Aug 03 19:18:50.454365 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_fb9177b6619c48e38c20abcda2ebadd4", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/fb9177b6619c48e38c20abcda2ebadd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/fb9177b6619c48e38c20abcda2ebadd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/fb9177b6619c48e38c20abcda2ebadd4"}]}] Aug 03 19:18:50.454365 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1411043165 Aug 03 19:18:50.454365 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Id: fb9177b6619c48e38c20abcda2ebadd4 Aug 03 19:18:50.454365 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1411043165 Aug 03 19:18:50.454365 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User: tempest-AttachVolumeShelveTestJSON-1411043165-project Aug 03 19:18:50.454365 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Id: default Aug 03 19:18:50.454365 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Name: Default Aug 03 19:18:50.454365 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Id: 3ad3e2057063434a8938a6e1309782c4 Aug 03 19:18:50.454365 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1411043165-project Aug 03 19:18:50.454365 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: method: > Aug 03 19:18:50.454365 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: exception: Instance 70e81dd2-02cb-482b-8f18-1babaf5146e2 could not be found. Aug 03 19:18:50.454365 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: action_args: {'id': '70e81dd2-02cb-482b-8f18-1babaf5146e2'} Aug 03 19:18:50.455279 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:18:50.455279 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:18:50.455279 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:18:50.455279 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:18:50.455279 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:18:50.455279 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:18:50.455279 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:18:50.455279 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:18:50.455279 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:18:50.455279 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:18:50.455279 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70e81dd2-02cb-482b-8f18-1babaf5146e2 could not be found. Aug 03 19:18:50.455279 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:18:50.455279 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:18:50.455279 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:18:50.455279 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:18:50.455279 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:18:50.455279 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:18:50.455279 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:18:50.455279 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:18:50.455279 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:18:50.456626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:18:50.456626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:18:50.456626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:18:50.456626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:18:50.456626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:18:50.456626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:18:50.456626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:18:50.456626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70e81dd2-02cb-482b-8f18-1babaf5146e2 could not be found. Aug 03 19:18:50.456626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:18:50.456626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:18:50.456626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:18:50.456626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:18:50.456626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:18:50.456626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:18:50.456626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:18:50.456626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:18:50.456626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70e81dd2-02cb-482b-8f18-1babaf5146e2 could not be found. Aug 03 19:18:50.456626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:18:50.457831 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-2da38df7-efbf-4f68-ba40-c46f108fefa2 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Returning 404 to user: Instance 70e81dd2-02cb-482b-8f18-1babaf5146e2 could not be found. {{(pid=118303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:18:50.457831 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-2da38df7-efbf-4f68-ba40-c46f108fefa2 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 404 len: 111 microversion: 2.20 time: 0.031168 Aug 03 19:18:50.457831 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 454/905] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:18:50 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 19:18:50.463016 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-4ff407b1-bb7c-4609-bbc0-94c4079efa9b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '.version_select at 0x7f47861214c0>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:18:50.538632 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-4ff407b1-bb7c-4609-bbc0-94c4079efa9b tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1658208381" status: 204 len: 0 microversion: 2.20 time: 0.079322 Aug 03 19:18:50.539157 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 452/906] 10.222.0.77 () {60 vars in 1262 bytes} [Wed Aug 3 19:18:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1658208381 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 19:18:52.601438 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-2c8e4c99-6110-4751-a516-583d76651940 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:18:52.601929 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-2c8e4c99-6110-4751-a516-583d76651940 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:18:52.608486 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2c8e4c99-6110-4751-a516-583d76651940 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:18:52.608930 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2c8e4c99-6110-4751-a516-583d76651940 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:18:52.609693 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2c8e4c99-6110-4751-a516-583d76651940 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:18:52.610128 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2c8e4c99-6110-4751-a516-583d76651940 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:18:52.623403 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.wsgi [None req-2c8e4c99-6110-4751-a516-583d76651940 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] HTTP exception thrown: Instance 70e81dd2-02cb-482b-8f18-1babaf5146e2 could not be found. Aug 03 19:18:52.624908 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-2c8e4c99-6110-4751-a516-583d76651940 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Request method failure captured: Aug 03 19:18:52.624908 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: request: DELETE /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 HTTP/1.1 Aug 03 19:18:52.624908 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept: application/json Aug 03 19:18:52.624908 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept-Encoding: identity Aug 03 19:18:52.624908 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Connection: close Aug 03 19:18:52.624908 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Length: 0 Aug 03 19:18:52.624908 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Type: application/json Aug 03 19:18:52.624908 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Host: 10.222.0.77 Aug 03 19:18:52.624908 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Openstack-System-Scope: None Aug 03 19:18:52.624908 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: User-Agent: python-urllib3/1.26.11 Aug 03 19:18:52.624908 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Auth-Token: gAAAAABi6sgx46KEqIROZCyfP1h34-boPbWwPwd4T4Amm5Rx0Rx7moJYv2e0luuy3FqHtTHmnUgQ4o7xHrzlhTKXBRyo0ZiPWbXKR4cCBYx7LLgwlBoqsaLO8mEVikX_Hp3amqdlJtqy788Hx-BbzUBzZiKG8faaJoVotVZYD3MG0ZcVrz2bEXM Aug 03 19:18:52.624908 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Id: None Aug 03 19:18:52.624908 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Name: None Aug 03 19:18:52.624908 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Identity-Status: Confirmed Aug 03 19:18:52.624908 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Is-Admin-Project: True Aug 03 19:18:52.624908 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 19:18:52.624908 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Id: default Aug 03 19:18:52.624908 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Name: Default Aug 03 19:18:52.624908 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Id: fb9177b6619c48e38c20abcda2ebadd4 Aug 03 19:18:52.624908 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1411043165 Aug 03 19:18:52.624908 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Role: reader,member Aug 03 19:18:52.624908 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Roles: reader,member Aug 03 19:18:52.626606 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_fb9177b6619c48e38c20abcda2ebadd4", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/fb9177b6619c48e38c20abcda2ebadd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/fb9177b6619c48e38c20abcda2ebadd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/fb9177b6619c48e38c20abcda2ebadd4"}]}] Aug 03 19:18:52.626606 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1411043165 Aug 03 19:18:52.626606 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Id: fb9177b6619c48e38c20abcda2ebadd4 Aug 03 19:18:52.626606 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1411043165 Aug 03 19:18:52.626606 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User: tempest-AttachVolumeShelveTestJSON-1411043165-project Aug 03 19:18:52.626606 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Id: default Aug 03 19:18:52.626606 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Name: Default Aug 03 19:18:52.626606 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Id: 3ad3e2057063434a8938a6e1309782c4 Aug 03 19:18:52.626606 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1411043165-project Aug 03 19:18:52.626606 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: method: > Aug 03 19:18:52.626606 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: exception: Instance 70e81dd2-02cb-482b-8f18-1babaf5146e2 could not be found. Aug 03 19:18:52.626606 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: action_args: {'id': '70e81dd2-02cb-482b-8f18-1babaf5146e2'} Aug 03 19:18:52.627651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:18:52.627651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:18:52.627651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:18:52.627651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:18:52.627651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:18:52.627651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:18:52.627651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:18:52.627651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:18:52.627651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:18:52.627651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:18:52.627651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70e81dd2-02cb-482b-8f18-1babaf5146e2 could not be found. Aug 03 19:18:52.627651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:18:52.627651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:18:52.627651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:18:52.627651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:18:52.627651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:18:52.627651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:18:52.627651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:18:52.627651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:18:52.627651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:18:52.629170 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:18:52.629170 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 19:18:52.629170 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 19:18:52.629170 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 19:18:52.629170 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 19:18:52.629170 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:18:52.629170 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:18:52.629170 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:18:52.629170 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:18:52.629170 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70e81dd2-02cb-482b-8f18-1babaf5146e2 could not be found. Aug 03 19:18:52.629170 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:18:52.629170 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:18:52.629170 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:18:52.629170 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:18:52.629170 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:18:52.629170 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:18:52.629170 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:18:52.629170 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:18:52.629170 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70e81dd2-02cb-482b-8f18-1babaf5146e2 could not be found. Aug 03 19:18:52.629170 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:18:52.630632 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-2c8e4c99-6110-4751-a516-583d76651940 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Returning 404 to user: Instance 70e81dd2-02cb-482b-8f18-1babaf5146e2 could not be found. {{(pid=118303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:18:52.630632 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-2c8e4c99-6110-4751-a516-583d76651940 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "DELETE /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 404 len: 111 microversion: 2.20 time: 0.028682 Aug 03 19:18:52.630632 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 455/907] 10.222.0.77 () {60 vars in 1280 bytes} [Wed Aug 3 19:18:52 2022] DELETE /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 19:18:52.634783 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-fef6633d-219d-4ff6-b433-5e8d50136d42 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:18:52.635427 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-fef6633d-219d-4ff6-b433-5e8d50136d42 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 70e81dd2-02cb-482b-8f18-1babaf5146e2] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:18:52.643389 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fef6633d-219d-4ff6-b433-5e8d50136d42 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:18:52.643834 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fef6633d-219d-4ff6-b433-5e8d50136d42 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:18:52.644618 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fef6633d-219d-4ff6-b433-5e8d50136d42 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:18:52.645047 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fef6633d-219d-4ff6-b433-5e8d50136d42 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:18:52.658749 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.wsgi [None req-fef6633d-219d-4ff6-b433-5e8d50136d42 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] HTTP exception thrown: Instance 70e81dd2-02cb-482b-8f18-1babaf5146e2 could not be found. Aug 03 19:18:52.660397 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-fef6633d-219d-4ff6-b433-5e8d50136d42 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Request method failure captured: Aug 03 19:18:52.660397 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: request: GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 HTTP/1.1 Aug 03 19:18:52.660397 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept: application/json Aug 03 19:18:52.660397 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept-Encoding: identity Aug 03 19:18:52.660397 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Connection: close Aug 03 19:18:52.660397 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Length: 0 Aug 03 19:18:52.660397 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Type: application/json Aug 03 19:18:52.660397 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Host: 10.222.0.77 Aug 03 19:18:52.660397 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Openstack-System-Scope: None Aug 03 19:18:52.660397 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: User-Agent: python-urllib3/1.26.11 Aug 03 19:18:52.660397 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Auth-Token: gAAAAABi6sgx46KEqIROZCyfP1h34-boPbWwPwd4T4Amm5Rx0Rx7moJYv2e0luuy3FqHtTHmnUgQ4o7xHrzlhTKXBRyo0ZiPWbXKR4cCBYx7LLgwlBoqsaLO8mEVikX_Hp3amqdlJtqy788Hx-BbzUBzZiKG8faaJoVotVZYD3MG0ZcVrz2bEXM Aug 03 19:18:52.660397 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Id: None Aug 03 19:18:52.660397 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Name: None Aug 03 19:18:52.660397 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Identity-Status: Confirmed Aug 03 19:18:52.660397 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Is-Admin-Project: True Aug 03 19:18:52.660397 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 19:18:52.660397 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Id: default Aug 03 19:18:52.660397 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Name: Default Aug 03 19:18:52.660397 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Id: fb9177b6619c48e38c20abcda2ebadd4 Aug 03 19:18:52.660397 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1411043165 Aug 03 19:18:52.660397 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Role: reader,member Aug 03 19:18:52.660397 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Roles: reader,member Aug 03 19:18:52.662123 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_fb9177b6619c48e38c20abcda2ebadd4", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/fb9177b6619c48e38c20abcda2ebadd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/fb9177b6619c48e38c20abcda2ebadd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/fb9177b6619c48e38c20abcda2ebadd4"}]}] Aug 03 19:18:52.662123 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1411043165 Aug 03 19:18:52.662123 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Id: fb9177b6619c48e38c20abcda2ebadd4 Aug 03 19:18:52.662123 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1411043165 Aug 03 19:18:52.662123 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User: tempest-AttachVolumeShelveTestJSON-1411043165-project Aug 03 19:18:52.662123 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Id: default Aug 03 19:18:52.662123 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Name: Default Aug 03 19:18:52.662123 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Id: 3ad3e2057063434a8938a6e1309782c4 Aug 03 19:18:52.662123 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1411043165-project Aug 03 19:18:52.662123 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: method: > Aug 03 19:18:52.662123 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: exception: Instance 70e81dd2-02cb-482b-8f18-1babaf5146e2 could not be found. Aug 03 19:18:52.662123 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: action_args: {'id': '70e81dd2-02cb-482b-8f18-1babaf5146e2'} Aug 03 19:18:52.662999 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:18:52.662999 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:18:52.662999 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:18:52.662999 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:18:52.662999 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:18:52.662999 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:18:52.662999 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:18:52.662999 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:18:52.662999 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:18:52.662999 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:18:52.662999 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70e81dd2-02cb-482b-8f18-1babaf5146e2 could not be found. Aug 03 19:18:52.662999 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:18:52.662999 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:18:52.662999 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:18:52.662999 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:18:52.662999 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:18:52.662999 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:18:52.662999 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:18:52.662999 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:18:52.662999 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:18:52.664339 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:18:52.664339 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:18:52.664339 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:18:52.664339 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:18:52.664339 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:18:52.664339 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:18:52.664339 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:18:52.664339 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70e81dd2-02cb-482b-8f18-1babaf5146e2 could not be found. Aug 03 19:18:52.664339 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:18:52.664339 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:18:52.664339 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:18:52.664339 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:18:52.664339 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:18:52.664339 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:18:52.664339 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:18:52.664339 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:18:52.664339 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70e81dd2-02cb-482b-8f18-1babaf5146e2 could not be found. Aug 03 19:18:52.664339 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:18:52.665444 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-fef6633d-219d-4ff6-b433-5e8d50136d42 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Returning 404 to user: Instance 70e81dd2-02cb-482b-8f18-1babaf5146e2 could not be found. {{(pid=118302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:18:52.665444 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-fef6633d-219d-4ff6-b433-5e8d50136d42 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2" status: 404 len: 111 microversion: 2.20 time: 0.030830 Aug 03 19:18:52.665444 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 453/908] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:18:52 2022] GET /compute/v2.1/servers/70e81dd2-02cb-482b-8f18-1babaf5146e2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 19:18:53.942510 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-4d7da08a-4126-410a-b86c-8bd0a4d34efc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:18:53.943033 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-4d7da08a-4126-410a-b86c-8bd0a4d34efc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:18:53.949491 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4d7da08a-4126-410a-b86c-8bd0a4d34efc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:18:53.949938 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4d7da08a-4126-410a-b86c-8bd0a4d34efc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:18:53.950757 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4d7da08a-4126-410a-b86c-8bd0a4d34efc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:18:53.951219 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4d7da08a-4126-410a-b86c-8bd0a4d34efc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:18:53.964209 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.wsgi [None req-4d7da08a-4126-410a-b86c-8bd0a4d34efc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] HTTP exception thrown: Instance 2e21c8ef-c172-41cd-806e-f69f81116b6a could not be found. Aug 03 19:18:53.965715 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-4d7da08a-4126-410a-b86c-8bd0a4d34efc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Request method failure captured: Aug 03 19:18:53.965715 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: request: DELETE /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a HTTP/1.1 Aug 03 19:18:53.965715 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept: application/json Aug 03 19:18:53.965715 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept-Encoding: identity Aug 03 19:18:53.965715 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Connection: close Aug 03 19:18:53.965715 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Length: 0 Aug 03 19:18:53.965715 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Type: application/json Aug 03 19:18:53.965715 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Host: 10.222.0.77 Aug 03 19:18:53.965715 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Openstack-System-Scope: None Aug 03 19:18:53.965715 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: User-Agent: python-urllib3/1.26.11 Aug 03 19:18:53.965715 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Auth-Token: gAAAAABi6sgx46KEqIROZCyfP1h34-boPbWwPwd4T4Amm5Rx0Rx7moJYv2e0luuy3FqHtTHmnUgQ4o7xHrzlhTKXBRyo0ZiPWbXKR4cCBYx7LLgwlBoqsaLO8mEVikX_Hp3amqdlJtqy788Hx-BbzUBzZiKG8faaJoVotVZYD3MG0ZcVrz2bEXM Aug 03 19:18:53.965715 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Id: None Aug 03 19:18:53.965715 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Name: None Aug 03 19:18:53.965715 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Identity-Status: Confirmed Aug 03 19:18:53.965715 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Is-Admin-Project: True Aug 03 19:18:53.965715 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 19:18:53.965715 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Id: default Aug 03 19:18:53.965715 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Name: Default Aug 03 19:18:53.965715 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Id: fb9177b6619c48e38c20abcda2ebadd4 Aug 03 19:18:53.965715 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1411043165 Aug 03 19:18:53.965715 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Role: reader,member Aug 03 19:18:53.965715 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Roles: reader,member Aug 03 19:18:53.967380 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_fb9177b6619c48e38c20abcda2ebadd4", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/fb9177b6619c48e38c20abcda2ebadd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/fb9177b6619c48e38c20abcda2ebadd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/fb9177b6619c48e38c20abcda2ebadd4"}]}] Aug 03 19:18:53.967380 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1411043165 Aug 03 19:18:53.967380 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Id: fb9177b6619c48e38c20abcda2ebadd4 Aug 03 19:18:53.967380 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1411043165 Aug 03 19:18:53.967380 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User: tempest-AttachVolumeShelveTestJSON-1411043165-project Aug 03 19:18:53.967380 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Id: default Aug 03 19:18:53.967380 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Name: Default Aug 03 19:18:53.967380 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Id: 3ad3e2057063434a8938a6e1309782c4 Aug 03 19:18:53.967380 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1411043165-project Aug 03 19:18:53.967380 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: method: > Aug 03 19:18:53.967380 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: exception: Instance 2e21c8ef-c172-41cd-806e-f69f81116b6a could not be found. Aug 03 19:18:53.967380 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: action_args: {'id': '2e21c8ef-c172-41cd-806e-f69f81116b6a'} Aug 03 19:18:53.968380 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:18:53.968380 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:18:53.968380 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:18:53.968380 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:18:53.968380 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:18:53.968380 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:18:53.968380 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:18:53.968380 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:18:53.968380 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:18:53.968380 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:18:53.968380 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e21c8ef-c172-41cd-806e-f69f81116b6a could not be found. Aug 03 19:18:53.968380 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:18:53.968380 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:18:53.968380 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:18:53.968380 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:18:53.968380 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:18:53.968380 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:18:53.968380 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:18:53.968380 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:18:53.968380 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:18:53.969859 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:18:53.969859 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 19:18:53.969859 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 19:18:53.969859 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 19:18:53.969859 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 19:18:53.969859 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:18:53.969859 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:18:53.969859 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:18:53.969859 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:18:53.969859 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e21c8ef-c172-41cd-806e-f69f81116b6a could not be found. Aug 03 19:18:53.969859 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:18:53.969859 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:18:53.969859 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:18:53.969859 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:18:53.969859 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:18:53.969859 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:18:53.969859 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:18:53.969859 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:18:53.969859 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e21c8ef-c172-41cd-806e-f69f81116b6a could not be found. Aug 03 19:18:53.969859 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:18:53.971373 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-4d7da08a-4126-410a-b86c-8bd0a4d34efc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Returning 404 to user: Instance 2e21c8ef-c172-41cd-806e-f69f81116b6a could not be found. {{(pid=118303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:18:53.971373 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-4d7da08a-4126-410a-b86c-8bd0a4d34efc tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "DELETE /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 404 len: 111 microversion: 2.20 time: 0.028410 Aug 03 19:18:53.971373 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 456/909] 10.222.0.77 () {60 vars in 1280 bytes} [Wed Aug 3 19:18:53 2022] DELETE /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 19:18:53.976085 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-991f7a56-870b-4bf0-af86-06be3879c8c0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:18:53.976702 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-991f7a56-870b-4bf0-af86-06be3879c8c0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] [instance: 2e21c8ef-c172-41cd-806e-f69f81116b6a] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:18:53.984129 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-991f7a56-870b-4bf0-af86-06be3879c8c0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:18:53.984583 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-991f7a56-870b-4bf0-af86-06be3879c8c0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:18:53.985353 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-991f7a56-870b-4bf0-af86-06be3879c8c0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:18:53.985796 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-991f7a56-870b-4bf0-af86-06be3879c8c0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:18:53.999814 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.wsgi [None req-991f7a56-870b-4bf0-af86-06be3879c8c0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] HTTP exception thrown: Instance 2e21c8ef-c172-41cd-806e-f69f81116b6a could not be found. Aug 03 19:18:54.001338 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-991f7a56-870b-4bf0-af86-06be3879c8c0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Request method failure captured: Aug 03 19:18:54.001338 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: request: GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a HTTP/1.1 Aug 03 19:18:54.001338 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept: application/json Aug 03 19:18:54.001338 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept-Encoding: identity Aug 03 19:18:54.001338 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Connection: close Aug 03 19:18:54.001338 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Length: 0 Aug 03 19:18:54.001338 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Type: application/json Aug 03 19:18:54.001338 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Host: 10.222.0.77 Aug 03 19:18:54.001338 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Openstack-System-Scope: None Aug 03 19:18:54.001338 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: User-Agent: python-urllib3/1.26.11 Aug 03 19:18:54.001338 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Auth-Token: gAAAAABi6sgx46KEqIROZCyfP1h34-boPbWwPwd4T4Amm5Rx0Rx7moJYv2e0luuy3FqHtTHmnUgQ4o7xHrzlhTKXBRyo0ZiPWbXKR4cCBYx7LLgwlBoqsaLO8mEVikX_Hp3amqdlJtqy788Hx-BbzUBzZiKG8faaJoVotVZYD3MG0ZcVrz2bEXM Aug 03 19:18:54.001338 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Id: None Aug 03 19:18:54.001338 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Name: None Aug 03 19:18:54.001338 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Identity-Status: Confirmed Aug 03 19:18:54.001338 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Is-Admin-Project: True Aug 03 19:18:54.001338 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 19:18:54.001338 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Id: default Aug 03 19:18:54.001338 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Name: Default Aug 03 19:18:54.001338 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Id: fb9177b6619c48e38c20abcda2ebadd4 Aug 03 19:18:54.001338 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1411043165 Aug 03 19:18:54.001338 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Role: reader,member Aug 03 19:18:54.001338 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Roles: reader,member Aug 03 19:18:54.003045 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_fb9177b6619c48e38c20abcda2ebadd4", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/fb9177b6619c48e38c20abcda2ebadd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/fb9177b6619c48e38c20abcda2ebadd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/fb9177b6619c48e38c20abcda2ebadd4"}]}] Aug 03 19:18:54.003045 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1411043165 Aug 03 19:18:54.003045 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Id: fb9177b6619c48e38c20abcda2ebadd4 Aug 03 19:18:54.003045 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1411043165 Aug 03 19:18:54.003045 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User: tempest-AttachVolumeShelveTestJSON-1411043165-project Aug 03 19:18:54.003045 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Id: default Aug 03 19:18:54.003045 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Name: Default Aug 03 19:18:54.003045 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Id: 3ad3e2057063434a8938a6e1309782c4 Aug 03 19:18:54.003045 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1411043165-project Aug 03 19:18:54.003045 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: method: > Aug 03 19:18:54.003045 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: exception: Instance 2e21c8ef-c172-41cd-806e-f69f81116b6a could not be found. Aug 03 19:18:54.003045 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: action_args: {'id': '2e21c8ef-c172-41cd-806e-f69f81116b6a'} Aug 03 19:18:54.003950 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:18:54.003950 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:18:54.003950 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:18:54.003950 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:18:54.003950 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:18:54.003950 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:18:54.003950 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:18:54.003950 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:18:54.003950 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:18:54.003950 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:18:54.003950 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e21c8ef-c172-41cd-806e-f69f81116b6a could not be found. Aug 03 19:18:54.003950 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:18:54.003950 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:18:54.003950 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:18:54.003950 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:18:54.003950 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:18:54.003950 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:18:54.003950 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:18:54.003950 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:18:54.003950 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:18:54.005421 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:18:54.005421 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:18:54.005421 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:18:54.005421 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:18:54.005421 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:18:54.005421 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:18:54.005421 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:18:54.005421 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e21c8ef-c172-41cd-806e-f69f81116b6a could not be found. Aug 03 19:18:54.005421 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:18:54.005421 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:18:54.005421 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:18:54.005421 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:18:54.005421 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:18:54.005421 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:18:54.005421 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:18:54.005421 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:18:54.005421 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e21c8ef-c172-41cd-806e-f69f81116b6a could not be found. Aug 03 19:18:54.005421 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:18:54.006781 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-991f7a56-870b-4bf0-af86-06be3879c8c0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] Returning 404 to user: Instance 2e21c8ef-c172-41cd-806e-f69f81116b6a could not be found. {{(pid=118302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:18:54.006781 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-991f7a56-870b-4bf0-af86-06be3879c8c0 tempest-AttachVolumeShelveTestJSON-1411043165 tempest-AttachVolumeShelveTestJSON-1411043165-project] 10.222.0.77 "GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a" status: 404 len: 111 microversion: 2.20 time: 0.030504 Aug 03 19:18:54.006781 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 454/910] 10.222.0.77 () {60 vars in 1277 bytes} [Wed Aug 3 19:18:53 2022] GET /compute/v2.1/servers/2e21c8ef-c172-41cd-806e-f69f81116b6a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 03 19:19:04.972767 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:19:04.973528 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:19:05.094903 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-9242f23e-efe1-4cbc-ba58-324281b016bd tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Action: 'create', calling method: .version_select at 0x7f4786158d30>, body: {"keypair": {"name": "tempest-keypair-161603596", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJJMu2Y2QvWg5ddgQx+UKjYSZsZWT8vvE2VZKYxosf1BpiGItbUSj2kFMV2wln4p0e9bwNC7LDNGQ7RuW/qDesuCRgJ3yAqPIcLWPwHaQ1SMyTsvWQ54kF2S8eIfC2Nqg=="}} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:19:05.112076 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.quota [None req-9242f23e-efe1-4cbc-ba58-324281b016bd tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Getting quotas for project e02e6595d2284de190bb759806ca02f6. Resources: {'key_pairs'} {{(pid=118303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:19:05.115960 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.quota [None req-9242f23e-efe1-4cbc-ba58-324281b016bd tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Getting quotas for user 32425eddf65f477db53594f7d4b447e2 and project e02e6595d2284de190bb759806ca02f6. Resources: {'key_pairs'} {{(pid=118303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:19:05.198813 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-9242f23e-efe1-4cbc-ba58-324281b016bd tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.231434 Aug 03 19:19:05.199475 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 457/911] 10.222.0.77 () {60 vars in 1159 bytes} [Wed Aug 3 19:19:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 19:19:07.566459 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-6cb3f8d5-c5bb-468e-a943-664cd21c6495 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2054063873", "imageRef": "0b6be242-215e-4886-a0d2-b8d5f8ca623e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b27e972d-f40b-4fda-b5a4-b93304ec49ce"}], "security_groups": [{"name": "tempest-securitygroup--55977996"}], "key_name": "tempest-keypair-161603596", "user_data": "}} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:19:07.574987 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:19:07.575755 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=30 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:19:07.687900 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.network.neutron [None req-6cb3f8d5-c5bb-468e-a943-664cd21c6495 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] validate_networks() for [('b27e972d-f40b-4fda-b5a4-b93304ec49ce', None, None, None, None, None)] {{(pid=118302) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 19:19:08.176295 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-6cb3f8d5-c5bb-468e-a943-664cd21c6495 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Flavor limits 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 19:19:08.183132 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-6cb3f8d5-c5bb-468e-a943-664cd21c6495 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Image limits 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 19:19:08.183132 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-6cb3f8d5-c5bb-468e-a943-664cd21c6495 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Flavor pref 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 19:19:08.183132 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-6cb3f8d5-c5bb-468e-a943-664cd21c6495 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Image pref 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 19:19:08.183132 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-6cb3f8d5-c5bb-468e-a943-664cd21c6495 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 19:19:08.192847 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-6cb3f8d5-c5bb-468e-a943-664cd21c6495 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:19:08.193302 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-6cb3f8d5-c5bb-468e-a943-664cd21c6495 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:19:08.194105 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-6cb3f8d5-c5bb-468e-a943-664cd21c6495 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:19:08.194547 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-6cb3f8d5-c5bb-468e-a943-664cd21c6495 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:19:08.213534 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.quota [None req-6cb3f8d5-c5bb-468e-a943-664cd21c6495 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Getting quotas for project e02e6595d2284de190bb759806ca02f6. Resources: {'instances', 'cores', 'ram'} {{(pid=118302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:19:08.217940 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.quota [None req-6cb3f8d5-c5bb-468e-a943-664cd21c6495 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Getting quotas for user 32425eddf65f477db53594f7d4b447e2 and project e02e6595d2284de190bb759806ca02f6. Resources: {'instances', 'cores', 'ram'} {{(pid=118302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:19:08.229632 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-6cb3f8d5-c5bb-468e-a943-664cd21c6495 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Going to run 1 instances... {{(pid=118302) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 19:19:08.232519 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-6cb3f8d5-c5bb-468e-a943-664cd21c6495 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 935a7612-a68e-4af7-a688-c94efb1f2676] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0b6be242-215e-4886-a0d2-b8d5f8ca623e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 19:19:08.382972 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-6cb3f8d5-c5bb-468e-a943-664cd21c6495 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.820737 Aug 03 19:19:08.383649 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 455/912] 10.222.0.77 () {60 vars in 1147 bytes} [Wed Aug 3 19:19:07 2022] POST /compute/v2.1/servers => generated 400 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 19:19:08.395371 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-ddb975d5-31fd-4737-a9ab-2625c4e36628 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:19:08.395979 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-ddb975d5-31fd-4737-a9ab-2625c4e36628 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 935a7612-a68e-4af7-a688-c94efb1f2676] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:19:08.462530 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-ddb975d5-31fd-4737-a9ab-2625c4e36628 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:19:08.470283 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-ddb975d5-31fd-4737-a9ab-2625c4e36628 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676" status: 200 len: 1241 microversion: 2.1 time: 0.079416 Aug 03 19:19:08.482108 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 458/913] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:19:08 2022] GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676 => generated 1241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:19:09.493061 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-75ea5959-4a24-4355-b5e0-0daf95b75233 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:19:09.493632 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-75ea5959-4a24-4355-b5e0-0daf95b75233 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 935a7612-a68e-4af7-a688-c94efb1f2676] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:19:09.501080 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-75ea5959-4a24-4355-b5e0-0daf95b75233 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:19:09.501529 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-75ea5959-4a24-4355-b5e0-0daf95b75233 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:19:09.502311 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-75ea5959-4a24-4355-b5e0-0daf95b75233 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:19:09.502731 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-75ea5959-4a24-4355-b5e0-0daf95b75233 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:19:09.569945 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-75ea5959-4a24-4355-b5e0-0daf95b75233 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:19:09.578086 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-75ea5959-4a24-4355-b5e0-0daf95b75233 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676" status: 200 len: 1245 microversion: 2.1 time: 0.089982 Aug 03 19:19:09.578691 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 456/914] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:19:09 2022] GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676 => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:19:10.600143 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-3d177534-2061-4a73-8a3b-98affa1cc019 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:19:10.601525 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-3d177534-2061-4a73-8a3b-98affa1cc019 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 935a7612-a68e-4af7-a688-c94efb1f2676] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:19:10.609706 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3d177534-2061-4a73-8a3b-98affa1cc019 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:19:10.610154 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3d177534-2061-4a73-8a3b-98affa1cc019 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:19:10.610929 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3d177534-2061-4a73-8a3b-98affa1cc019 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:19:10.611378 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3d177534-2061-4a73-8a3b-98affa1cc019 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:19:10.687774 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-3d177534-2061-4a73-8a3b-98affa1cc019 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:19:10.695848 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-3d177534-2061-4a73-8a3b-98affa1cc019 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676" status: 200 len: 1301 microversion: 2.1 time: 0.099512 Aug 03 19:19:10.696499 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 459/915] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:19:10 2022] GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676 => generated 1301 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:19:11.717338 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-fc9e7962-5a74-42e5-8c6b-621f481cf799 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:19:11.718555 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-fc9e7962-5a74-42e5-8c6b-621f481cf799 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 935a7612-a68e-4af7-a688-c94efb1f2676] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:19:11.725402 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fc9e7962-5a74-42e5-8c6b-621f481cf799 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:19:11.725854 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fc9e7962-5a74-42e5-8c6b-621f481cf799 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:19:11.726657 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fc9e7962-5a74-42e5-8c6b-621f481cf799 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:19:11.727224 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fc9e7962-5a74-42e5-8c6b-621f481cf799 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:19:11.868261 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-fc9e7962-5a74-42e5-8c6b-621f481cf799 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:19:11.877100 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-fc9e7962-5a74-42e5-8c6b-621f481cf799 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676" status: 200 len: 1365 microversion: 2.1 time: 0.164020 Aug 03 19:19:11.877782 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 457/916] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:19:11 2022] GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:19:12.516227 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [req-41204c87-b689-4fbe-9eda-51c509d9ac43 req-19a90032-5cbd-44fe-a17a-99d69c7fe5c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "935a7612-a68e-4af7-a688-c94efb1f2676", "tag": "bf943d42-e379-4c01-89fb-856616c1346c"}]} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:19:12.525585 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-41204c87-b689-4fbe-9eda-51c509d9ac43 req-19a90032-5cbd-44fe-a17a-99d69c7fe5c5 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:19:12.529139 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-41204c87-b689-4fbe-9eda-51c509d9ac43 req-19a90032-5cbd-44fe-a17a-99d69c7fe5c5 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:19:12.537266 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.compute.server_external_events [req-41204c87-b689-4fbe-9eda-51c509d9ac43 req-19a90032-5cbd-44fe-a17a-99d69c7fe5c5 service nova] Creating event network-changed:bf943d42-e379-4c01-89fb-856616c1346c for instance 935a7612-a68e-4af7-a688-c94efb1f2676 on hv-cinder-85202 Aug 03 19:19:12.542331 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [req-41204c87-b689-4fbe-9eda-51c509d9ac43 req-19a90032-5cbd-44fe-a17a-99d69c7fe5c5 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089567 Aug 03 19:19:12.542875 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 460/917] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:19:12.897791 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-cd704461-deeb-4569-83f6-df289f6e7d37 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:19:12.899079 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-cd704461-deeb-4569-83f6-df289f6e7d37 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 935a7612-a68e-4af7-a688-c94efb1f2676] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:19:12.906713 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-cd704461-deeb-4569-83f6-df289f6e7d37 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:19:12.907321 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-cd704461-deeb-4569-83f6-df289f6e7d37 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:19:12.908111 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-cd704461-deeb-4569-83f6-df289f6e7d37 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:19:12.908558 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-cd704461-deeb-4569-83f6-df289f6e7d37 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:19:13.054270 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-cd704461-deeb-4569-83f6-df289f6e7d37 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:19:13.064130 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-cd704461-deeb-4569-83f6-df289f6e7d37 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676" status: 200 len: 1365 microversion: 2.1 time: 0.170077 Aug 03 19:19:13.074159 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 458/918] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:19:12 2022] GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:19:14.087524 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-ad36ec0e-28ed-41f2-b4d4-f1e4f8f5d246 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:19:14.088138 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-ad36ec0e-28ed-41f2-b4d4-f1e4f8f5d246 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 935a7612-a68e-4af7-a688-c94efb1f2676] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:19:14.095088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ad36ec0e-28ed-41f2-b4d4-f1e4f8f5d246 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:19:14.095538 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ad36ec0e-28ed-41f2-b4d4-f1e4f8f5d246 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:19:14.096305 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ad36ec0e-28ed-41f2-b4d4-f1e4f8f5d246 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:19:14.096745 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ad36ec0e-28ed-41f2-b4d4-f1e4f8f5d246 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:19:14.228855 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-ad36ec0e-28ed-41f2-b4d4-f1e4f8f5d246 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:19:14.236658 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-ad36ec0e-28ed-41f2-b4d4-f1e4f8f5d246 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676" status: 200 len: 1365 microversion: 2.1 time: 0.153933 Aug 03 19:19:14.237239 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 461/919] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:19:14 2022] GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:19:15.257817 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-326948dd-c009-48c7-b121-693a8955e085 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:19:15.258463 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-326948dd-c009-48c7-b121-693a8955e085 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 935a7612-a68e-4af7-a688-c94efb1f2676] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:19:15.265276 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-326948dd-c009-48c7-b121-693a8955e085 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:19:15.265731 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-326948dd-c009-48c7-b121-693a8955e085 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:19:15.266497 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-326948dd-c009-48c7-b121-693a8955e085 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:19:15.266936 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-326948dd-c009-48c7-b121-693a8955e085 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:19:15.404163 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-326948dd-c009-48c7-b121-693a8955e085 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:19:15.411877 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-326948dd-c009-48c7-b121-693a8955e085 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676" status: 200 len: 1365 microversion: 2.1 time: 0.158055 Aug 03 19:19:15.412438 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 459/920] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:19:15 2022] GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:19:16.433277 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-3d8691a0-ef2f-4574-b098-6546a43cebbe tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:19:16.433888 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-3d8691a0-ef2f-4574-b098-6546a43cebbe tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 935a7612-a68e-4af7-a688-c94efb1f2676] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:19:16.441290 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3d8691a0-ef2f-4574-b098-6546a43cebbe tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:19:16.441735 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3d8691a0-ef2f-4574-b098-6546a43cebbe tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:19:16.442504 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3d8691a0-ef2f-4574-b098-6546a43cebbe tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:19:16.442938 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3d8691a0-ef2f-4574-b098-6546a43cebbe tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:19:16.582040 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-3d8691a0-ef2f-4574-b098-6546a43cebbe tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:19:16.589484 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-3d8691a0-ef2f-4574-b098-6546a43cebbe tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676" status: 200 len: 1365 microversion: 2.1 time: 0.160071 Aug 03 19:19:16.590037 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 462/921] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:19:16 2022] GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:19:17.611718 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-fe239d75-c2f3-4b3a-9f8c-60ae3a64cf1c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:19:17.612372 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-fe239d75-c2f3-4b3a-9f8c-60ae3a64cf1c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 935a7612-a68e-4af7-a688-c94efb1f2676] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:19:17.619210 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fe239d75-c2f3-4b3a-9f8c-60ae3a64cf1c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:19:17.619655 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fe239d75-c2f3-4b3a-9f8c-60ae3a64cf1c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:19:17.620569 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fe239d75-c2f3-4b3a-9f8c-60ae3a64cf1c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:19:17.621000 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-fe239d75-c2f3-4b3a-9f8c-60ae3a64cf1c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:19:17.761956 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-fe239d75-c2f3-4b3a-9f8c-60ae3a64cf1c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:19:17.770338 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-fe239d75-c2f3-4b3a-9f8c-60ae3a64cf1c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676" status: 200 len: 1365 microversion: 2.1 time: 0.162693 Aug 03 19:19:17.770910 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 460/922] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:19:17 2022] GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:19:17.924341 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [req-88fa743a-8084-41b9-9200-ac045d20e04d req-f9c01074-f190-4d26-b581-fad582529d40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "935a7612-a68e-4af7-a688-c94efb1f2676", "name": "network-vif-plugged", "status": "completed", "tag": "bf943d42-e379-4c01-89fb-856616c1346c"}]} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:19:17.935311 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-88fa743a-8084-41b9-9200-ac045d20e04d req-f9c01074-f190-4d26-b581-fad582529d40 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:19:17.935765 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-88fa743a-8084-41b9-9200-ac045d20e04d req-f9c01074-f190-4d26-b581-fad582529d40 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:19:17.947018 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.compute.server_external_events [req-88fa743a-8084-41b9-9200-ac045d20e04d req-f9c01074-f190-4d26-b581-fad582529d40 service nova] Creating event network-vif-plugged:bf943d42-e379-4c01-89fb-856616c1346c for instance 935a7612-a68e-4af7-a688-c94efb1f2676 on hv-cinder-85202 Aug 03 19:19:17.952444 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [req-88fa743a-8084-41b9-9200-ac045d20e04d req-f9c01074-f190-4d26-b581-fad582529d40 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031703 Aug 03 19:19:17.953037 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 463/923] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:19:18.791048 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-05f2060a-036c-4419-8e98-36c267609003 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:19:18.791587 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-05f2060a-036c-4419-8e98-36c267609003 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 935a7612-a68e-4af7-a688-c94efb1f2676] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:19:18.793382 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell0:SELECT=2 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:19:18.794702 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell0:SELECT=6 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:19:18.800605 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-05f2060a-036c-4419-8e98-36c267609003 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:19:18.801104 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-05f2060a-036c-4419-8e98-36c267609003 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:19:18.802134 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-05f2060a-036c-4419-8e98-36c267609003 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:19:18.802587 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-05f2060a-036c-4419-8e98-36c267609003 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:19:18.942692 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-05f2060a-036c-4419-8e98-36c267609003 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:19:18.950306 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-05f2060a-036c-4419-8e98-36c267609003 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676" status: 200 len: 1365 microversion: 2.1 time: 0.163223 Aug 03 19:19:18.952548 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 461/924] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:19:18 2022] GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:19:19.967956 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell0:SELECT=6 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:19:19.972522 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-f5c5ea6c-eef3-4107-ba5b-2248b73d2c50 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:19:19.973380 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-f5c5ea6c-eef3-4107-ba5b-2248b73d2c50 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 935a7612-a68e-4af7-a688-c94efb1f2676] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:19:19.979743 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f5c5ea6c-eef3-4107-ba5b-2248b73d2c50 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:19:19.980191 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f5c5ea6c-eef3-4107-ba5b-2248b73d2c50 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:19:19.980953 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f5c5ea6c-eef3-4107-ba5b-2248b73d2c50 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:19:19.981484 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f5c5ea6c-eef3-4107-ba5b-2248b73d2c50 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:19:20.133014 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-f5c5ea6c-eef3-4107-ba5b-2248b73d2c50 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:19:20.143035 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-f5c5ea6c-eef3-4107-ba5b-2248b73d2c50 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676" status: 200 len: 1365 microversion: 2.1 time: 0.175783 Aug 03 19:19:20.143584 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 464/925] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:19:19 2022] GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:19:21.164889 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-aa958a11-8a27-4aff-bffe-7f452dac478b tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:19:21.165698 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-aa958a11-8a27-4aff-bffe-7f452dac478b tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 935a7612-a68e-4af7-a688-c94efb1f2676] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:19:21.172727 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-aa958a11-8a27-4aff-bffe-7f452dac478b tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:19:21.173172 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-aa958a11-8a27-4aff-bffe-7f452dac478b tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:19:21.173950 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-aa958a11-8a27-4aff-bffe-7f452dac478b tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:19:21.174386 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-aa958a11-8a27-4aff-bffe-7f452dac478b tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:19:21.315291 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-aa958a11-8a27-4aff-bffe-7f452dac478b tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:19:21.322805 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-aa958a11-8a27-4aff-bffe-7f452dac478b tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676" status: 200 len: 1555 microversion: 2.1 time: 0.161796 Aug 03 19:19:21.323411 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 462/926] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:19:21 2022] GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:19:21.343297 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-63d7f2ec-3b17-4e60-851e-41d684c2f7f3 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:19:21.343845 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-63d7f2ec-3b17-4e60-851e-41d684c2f7f3 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 935a7612-a68e-4af7-a688-c94efb1f2676] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:19:21.350829 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-63d7f2ec-3b17-4e60-851e-41d684c2f7f3 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:19:21.351311 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-63d7f2ec-3b17-4e60-851e-41d684c2f7f3 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:19:21.352087 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-63d7f2ec-3b17-4e60-851e-41d684c2f7f3 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:19:21.352527 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-63d7f2ec-3b17-4e60-851e-41d684c2f7f3 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:19:21.430686 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-63d7f2ec-3b17-4e60-851e-41d684c2f7f3 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091864 Aug 03 19:19:21.431333 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 465/927] 10.222.0.77 () {58 vars in 1275 bytes} [Wed Aug 3 19:19:21 2022] GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:19:22.512124 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-07cbabe0-b95d-40ed-879b-77483a5d1e3a req-4dbc89ff-0cbe-4fed-a3da-cf2d1b259dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "935a7612-a68e-4af7-a688-c94efb1f2676", "tag": "bf943d42-e379-4c01-89fb-856616c1346c"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:19:22.514444 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-07cbabe0-b95d-40ed-879b-77483a5d1e3a req-4dbc89ff-0cbe-4fed-a3da-cf2d1b259dc3 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:19:22.515480 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-07cbabe0-b95d-40ed-879b-77483a5d1e3a req-4dbc89ff-0cbe-4fed-a3da-cf2d1b259dc3 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:19:22.527306 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-07cbabe0-b95d-40ed-879b-77483a5d1e3a req-4dbc89ff-0cbe-4fed-a3da-cf2d1b259dc3 service nova] Creating event network-changed:bf943d42-e379-4c01-89fb-856616c1346c for instance 935a7612-a68e-4af7-a688-c94efb1f2676 on hv-cinder-85202 Aug 03 19:19:22.534288 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-07cbabe0-b95d-40ed-879b-77483a5d1e3a req-4dbc89ff-0cbe-4fed-a3da-cf2d1b259dc3 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033495 Aug 03 19:19:22.540144 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 463/928] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:20:37.971343 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:20:37.972076 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=32 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:20:37.976236 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-4fb2dbdb-2624-4c84-8242-8b41b4a0c9e3 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:20:37.976864 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-4fb2dbdb-2624-4c84-8242-8b41b4a0c9e3 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 935a7612-a68e-4af7-a688-c94efb1f2676] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:20:37.983681 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4fb2dbdb-2624-4c84-8242-8b41b4a0c9e3 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:20:37.984137 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4fb2dbdb-2624-4c84-8242-8b41b4a0c9e3 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:20:37.984982 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4fb2dbdb-2624-4c84-8242-8b41b4a0c9e3 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:20:37.985328 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4fb2dbdb-2624-4c84-8242-8b41b4a0c9e3 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:20:38.009208 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-4fb2dbdb-2624-4c84-8242-8b41b4a0c9e3 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676/ips" status: 200 len: 149 microversion: 2.1 time: 0.039747 Aug 03 19:20:38.009768 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 466/929] 10.222.0.77 () {58 vars in 1248 bytes} [Wed Aug 3 19:20:37 2022] GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:20:40.740587 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:20:40.741307 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=46 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:20:40.745812 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-d6605e88-32c5-476d-9d77-e9b290839a9a tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68d20cfc-1c69-484e-ade4-fa534c8092b6"}} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:20:40.748880 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-d6605e88-32c5-476d-9d77-e9b290839a9a tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 935a7612-a68e-4af7-a688-c94efb1f2676] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:20:40.755503 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d6605e88-32c5-476d-9d77-e9b290839a9a tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:20:40.761007 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d6605e88-32c5-476d-9d77-e9b290839a9a tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:20:40.761007 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d6605e88-32c5-476d-9d77-e9b290839a9a tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:20:40.761007 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-d6605e88-32c5-476d-9d77-e9b290839a9a tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:20:41.405076 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-d6605e88-32c5-476d-9d77-e9b290839a9a tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "POST /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.665555 Aug 03 19:20:41.405760 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 464/930] 10.222.0.77 () {60 vars in 1323 bytes} [Wed Aug 3 19:20:40 2022] POST /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676/os-volume_attachments => generated 194 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:20:48.938354 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-0b98a0da-4d79-48cb-b4f0-e73ac3c0a227 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Action: 'create', calling method: .version_select at 0x7f4786158700>, body: {"keypair": {"name": "tempest-keypair-545347306", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIj27TW+SYdKYCik35R9rtptpmmjFizCp/f1O3F7pEbflFSdGe6QH+xYWU3SMM8E43fA+rgnfxIlY51V2rZp02xM9w6riCWkZWP0SU7o2swVXEwQy3fJMPsi5voc8N4AOw=="}} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:20:48.956142 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.quota [None req-0b98a0da-4d79-48cb-b4f0-e73ac3c0a227 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Getting quotas for project e02e6595d2284de190bb759806ca02f6. Resources: {'key_pairs'} {{(pid=118303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:20:48.959933 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.quota [None req-0b98a0da-4d79-48cb-b4f0-e73ac3c0a227 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Getting quotas for user 32425eddf65f477db53594f7d4b447e2 and project e02e6595d2284de190bb759806ca02f6. Resources: {'key_pairs'} {{(pid=118303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:20:49.082281 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-0b98a0da-4d79-48cb-b4f0-e73ac3c0a227 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.141710 Aug 03 19:20:49.082281 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 467/931] 10.222.0.77 () {60 vars in 1159 bytes} [Wed Aug 3 19:20:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:20:51.478666 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-8ad1d6cd-363d-4dac-97b0-3adec43f6047 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1957864149", "imageRef": "0b6be242-215e-4886-a0d2-b8d5f8ca623e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b27e972d-f40b-4fda-b5a4-b93304ec49ce"}], "security_groups": [{"name": "tempest-securitygroup--1812581546"}], "key_name": "tempest-keypair-545347306", "user_data": "}} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:20:51.488075 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_api:SELECT=2 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:20:51.488683 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:20:51.589102 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.network.neutron [None req-8ad1d6cd-363d-4dac-97b0-3adec43f6047 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] validate_networks() for [('b27e972d-f40b-4fda-b5a4-b93304ec49ce', None, None, None, None, None)] {{(pid=118302) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 19:20:52.004901 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-8ad1d6cd-363d-4dac-97b0-3adec43f6047 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Flavor limits 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 19:20:52.005355 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-8ad1d6cd-363d-4dac-97b0-3adec43f6047 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Image limits 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 19:20:52.005831 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-8ad1d6cd-363d-4dac-97b0-3adec43f6047 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Flavor pref 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 19:20:52.006251 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-8ad1d6cd-363d-4dac-97b0-3adec43f6047 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Image pref 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 19:20:52.006655 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-8ad1d6cd-363d-4dac-97b0-3adec43f6047 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 19:20:52.015704 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8ad1d6cd-363d-4dac-97b0-3adec43f6047 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:20:52.016153 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8ad1d6cd-363d-4dac-97b0-3adec43f6047 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:20:52.016955 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8ad1d6cd-363d-4dac-97b0-3adec43f6047 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:20:52.017398 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8ad1d6cd-363d-4dac-97b0-3adec43f6047 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:20:52.034539 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.quota [None req-8ad1d6cd-363d-4dac-97b0-3adec43f6047 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Getting quotas for project e02e6595d2284de190bb759806ca02f6. Resources: {'instances', 'cores', 'ram'} {{(pid=118302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:20:52.038405 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.quota [None req-8ad1d6cd-363d-4dac-97b0-3adec43f6047 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Getting quotas for user 32425eddf65f477db53594f7d4b447e2 and project e02e6595d2284de190bb759806ca02f6. Resources: {'instances', 'cores', 'ram'} {{(pid=118302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:20:52.050071 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-8ad1d6cd-363d-4dac-97b0-3adec43f6047 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Going to run 1 instances... {{(pid=118302) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 19:20:52.052473 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-8ad1d6cd-363d-4dac-97b0-3adec43f6047 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 257e78c5-4e3b-4ab7-a406-3260323d6657] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0b6be242-215e-4886-a0d2-b8d5f8ca623e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 19:20:52.181680 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-8ad1d6cd-363d-4dac-97b0-3adec43f6047 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.707626 Aug 03 19:20:52.182318 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 465/932] 10.222.0.77 () {60 vars in 1147 bytes} [Wed Aug 3 19:20:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 19:20:52.193858 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-c471d76c-9543-4717-bb7e-feaa9d87ea2c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:20:52.195110 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-c471d76c-9543-4717-bb7e-feaa9d87ea2c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 257e78c5-4e3b-4ab7-a406-3260323d6657] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:20:52.257727 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-c471d76c-9543-4717-bb7e-feaa9d87ea2c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:20:52.265696 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-c471d76c-9543-4717-bb7e-feaa9d87ea2c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657" status: 200 len: 1241 microversion: 2.1 time: 0.075629 Aug 03 19:20:52.266526 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 468/933] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:20:52 2022] GET /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657 => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:20:53.286646 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-c570e805-5434-400b-92ef-2200da752f66 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:20:53.287289 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-c570e805-5434-400b-92ef-2200da752f66 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 257e78c5-4e3b-4ab7-a406-3260323d6657] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:20:53.296505 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c570e805-5434-400b-92ef-2200da752f66 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:20:53.296958 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c570e805-5434-400b-92ef-2200da752f66 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:20:53.297729 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c570e805-5434-400b-92ef-2200da752f66 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:20:53.298163 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c570e805-5434-400b-92ef-2200da752f66 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:20:53.362977 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-c570e805-5434-400b-92ef-2200da752f66 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:20:53.370508 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-c570e805-5434-400b-92ef-2200da752f66 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657" status: 200 len: 1237 microversion: 2.1 time: 0.088264 Aug 03 19:20:53.372781 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 466/934] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:20:53 2022] GET /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657 => generated 1237 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:20:54.391765 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-08e19ac7-f7a0-4282-bab1-feb4463859e2 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:20:54.397298 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-08e19ac7-f7a0-4282-bab1-feb4463859e2 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 257e78c5-4e3b-4ab7-a406-3260323d6657] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:20:54.398915 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-08e19ac7-f7a0-4282-bab1-feb4463859e2 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:20:54.399395 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-08e19ac7-f7a0-4282-bab1-feb4463859e2 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:20:54.400163 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-08e19ac7-f7a0-4282-bab1-feb4463859e2 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:20:54.400595 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-08e19ac7-f7a0-4282-bab1-feb4463859e2 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:20:54.467681 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-08e19ac7-f7a0-4282-bab1-feb4463859e2 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:20:54.475249 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-08e19ac7-f7a0-4282-bab1-feb4463859e2 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657" status: 200 len: 1299 microversion: 2.1 time: 0.087542 Aug 03 19:20:54.486971 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 469/935] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:20:54 2022] GET /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657 => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:20:55.496398 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-46cbc4d8-8e04-430f-8ee5-6009f2ba7290 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:20:55.497041 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-46cbc4d8-8e04-430f-8ee5-6009f2ba7290 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 257e78c5-4e3b-4ab7-a406-3260323d6657] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:20:55.503947 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-46cbc4d8-8e04-430f-8ee5-6009f2ba7290 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:20:55.504400 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-46cbc4d8-8e04-430f-8ee5-6009f2ba7290 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:20:55.505224 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-46cbc4d8-8e04-430f-8ee5-6009f2ba7290 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:20:55.505660 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-46cbc4d8-8e04-430f-8ee5-6009f2ba7290 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:20:55.646912 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-46cbc4d8-8e04-430f-8ee5-6009f2ba7290 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:20:55.654424 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-46cbc4d8-8e04-430f-8ee5-6009f2ba7290 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657" status: 200 len: 1367 microversion: 2.1 time: 0.161888 Aug 03 19:20:55.654968 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 467/936] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:20:55 2022] GET /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:20:55.999733 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [req-675e045b-b97f-4374-8b8a-7dfe52242039 req-3cf12e4c-4513-43e0-931c-39be98e0cef0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "257e78c5-4e3b-4ab7-a406-3260323d6657", "tag": "9f2808c4-8550-4e62-bf08-d23c1047d90c"}]} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:20:56.009711 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-675e045b-b97f-4374-8b8a-7dfe52242039 req-3cf12e4c-4513-43e0-931c-39be98e0cef0 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:20:56.010154 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-675e045b-b97f-4374-8b8a-7dfe52242039 req-3cf12e4c-4513-43e0-931c-39be98e0cef0 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:20:56.023040 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.compute.server_external_events [req-675e045b-b97f-4374-8b8a-7dfe52242039 req-3cf12e4c-4513-43e0-931c-39be98e0cef0 service nova] Creating event network-changed:9f2808c4-8550-4e62-bf08-d23c1047d90c for instance 257e78c5-4e3b-4ab7-a406-3260323d6657 on hv-cinder-85202 Aug 03 19:20:56.028215 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [req-675e045b-b97f-4374-8b8a-7dfe52242039 req-3cf12e4c-4513-43e0-931c-39be98e0cef0 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032987 Aug 03 19:20:56.029110 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 470/937] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:20:56.673902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-910ffc91-85f1-4d17-a3ce-9c4677783614 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:20:56.674519 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-910ffc91-85f1-4d17-a3ce-9c4677783614 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 257e78c5-4e3b-4ab7-a406-3260323d6657] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:20:56.681309 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-910ffc91-85f1-4d17-a3ce-9c4677783614 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:20:56.681762 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-910ffc91-85f1-4d17-a3ce-9c4677783614 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:20:56.682841 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-910ffc91-85f1-4d17-a3ce-9c4677783614 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:20:56.687029 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-910ffc91-85f1-4d17-a3ce-9c4677783614 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:20:56.822615 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-910ffc91-85f1-4d17-a3ce-9c4677783614 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:20:56.830444 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-910ffc91-85f1-4d17-a3ce-9c4677783614 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657" status: 200 len: 1367 microversion: 2.1 time: 0.160647 Aug 03 19:20:56.831023 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 468/938] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:20:56 2022] GET /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:20:57.851686 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-5706217d-75c6-4843-8597-5f78d5eecedf tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:20:57.852298 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-5706217d-75c6-4843-8597-5f78d5eecedf tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 257e78c5-4e3b-4ab7-a406-3260323d6657] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:20:57.858469 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5706217d-75c6-4843-8597-5f78d5eecedf tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:20:57.858918 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5706217d-75c6-4843-8597-5f78d5eecedf tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:20:57.859711 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5706217d-75c6-4843-8597-5f78d5eecedf tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:20:57.860146 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5706217d-75c6-4843-8597-5f78d5eecedf tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:20:57.992097 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-5706217d-75c6-4843-8597-5f78d5eecedf tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:20:58.000230 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-5706217d-75c6-4843-8597-5f78d5eecedf tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657" status: 200 len: 1367 microversion: 2.1 time: 0.153534 Aug 03 19:20:58.000789 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 471/939] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:20:57 2022] GET /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:20:59.020655 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-17c323d2-6cbb-4ae9-b691-08c0def58ede tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:20:59.021314 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-17c323d2-6cbb-4ae9-b691-08c0def58ede tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 257e78c5-4e3b-4ab7-a406-3260323d6657] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:20:59.028061 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-17c323d2-6cbb-4ae9-b691-08c0def58ede tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:20:59.028514 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-17c323d2-6cbb-4ae9-b691-08c0def58ede tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:20:59.029440 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-17c323d2-6cbb-4ae9-b691-08c0def58ede tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:20:59.030118 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-17c323d2-6cbb-4ae9-b691-08c0def58ede tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:20:59.164007 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-17c323d2-6cbb-4ae9-b691-08c0def58ede tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:20:59.173130 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-17c323d2-6cbb-4ae9-b691-08c0def58ede tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657" status: 200 len: 1367 microversion: 2.1 time: 0.156255 Aug 03 19:20:59.173706 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 469/940] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:20:59 2022] GET /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:21:00.193786 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-0b8832ec-4667-417f-9285-7bcc06a06363 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:21:00.194393 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-0b8832ec-4667-417f-9285-7bcc06a06363 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 257e78c5-4e3b-4ab7-a406-3260323d6657] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:21:00.201333 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0b8832ec-4667-417f-9285-7bcc06a06363 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:21:00.201865 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0b8832ec-4667-417f-9285-7bcc06a06363 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:21:00.202631 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0b8832ec-4667-417f-9285-7bcc06a06363 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:21:00.203092 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-0b8832ec-4667-417f-9285-7bcc06a06363 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:21:00.340737 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-0b8832ec-4667-417f-9285-7bcc06a06363 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:21:00.349505 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-0b8832ec-4667-417f-9285-7bcc06a06363 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657" status: 200 len: 1367 microversion: 2.1 time: 0.159488 Aug 03 19:21:00.350085 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 472/941] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:21:00 2022] GET /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:21:01.369938 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-8575910d-2921-4d22-a709-639fbf0b3e93 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:21:01.370533 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-8575910d-2921-4d22-a709-639fbf0b3e93 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 257e78c5-4e3b-4ab7-a406-3260323d6657] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:21:01.378149 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8575910d-2921-4d22-a709-639fbf0b3e93 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:21:01.378631 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8575910d-2921-4d22-a709-639fbf0b3e93 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:21:01.379431 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8575910d-2921-4d22-a709-639fbf0b3e93 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:21:01.379879 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8575910d-2921-4d22-a709-639fbf0b3e93 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:21:01.518717 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-8575910d-2921-4d22-a709-639fbf0b3e93 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:21:01.526330 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-8575910d-2921-4d22-a709-639fbf0b3e93 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657" status: 200 len: 1367 microversion: 2.1 time: 0.160285 Aug 03 19:21:01.526895 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 470/942] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:21:01 2022] GET /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:21:02.517385 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [req-81a4da4d-ea63-4786-9f02-bd623fbb67dd req-a5da1e78-9ae9-4bb7-8bd7-348388cecb18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "257e78c5-4e3b-4ab7-a406-3260323d6657", "name": "network-vif-plugged", "status": "completed", "tag": "9f2808c4-8550-4e62-bf08-d23c1047d90c"}]} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:21:02.522695 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell0:SELECT=6 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:21:02.528174 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-81a4da4d-ea63-4786-9f02-bd623fbb67dd req-a5da1e78-9ae9-4bb7-8bd7-348388cecb18 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:21:02.528618 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-81a4da4d-ea63-4786-9f02-bd623fbb67dd req-a5da1e78-9ae9-4bb7-8bd7-348388cecb18 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:21:02.540112 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.compute.server_external_events [req-81a4da4d-ea63-4786-9f02-bd623fbb67dd req-a5da1e78-9ae9-4bb7-8bd7-348388cecb18 service nova] Creating event network-vif-plugged:9f2808c4-8550-4e62-bf08-d23c1047d90c for instance 257e78c5-4e3b-4ab7-a406-3260323d6657 on hv-cinder-85202 Aug 03 19:21:02.545871 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [req-81a4da4d-ea63-4786-9f02-bd623fbb67dd req-a5da1e78-9ae9-4bb7-8bd7-348388cecb18 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031875 Aug 03 19:21:02.546663 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 473/943] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 19:21:02.548115 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-7cb55db3-e1b6-4d0c-9025-04558b5fe87f tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:21:02.548719 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-7cb55db3-e1b6-4d0c-9025-04558b5fe87f tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 257e78c5-4e3b-4ab7-a406-3260323d6657] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:21:02.550605 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell0:SELECT=2 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:21:02.551286 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell0:SELECT=6 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:21:02.557245 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7cb55db3-e1b6-4d0c-9025-04558b5fe87f tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:21:02.557698 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7cb55db3-e1b6-4d0c-9025-04558b5fe87f tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:21:02.558482 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7cb55db3-e1b6-4d0c-9025-04558b5fe87f tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:21:02.558924 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7cb55db3-e1b6-4d0c-9025-04558b5fe87f tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:21:02.697488 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-7cb55db3-e1b6-4d0c-9025-04558b5fe87f tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:21:02.706381 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-7cb55db3-e1b6-4d0c-9025-04558b5fe87f tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657" status: 200 len: 1367 microversion: 2.1 time: 0.162674 Aug 03 19:21:02.710285 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 471/944] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:21:02 2022] GET /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:21:03.728480 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-a16847cf-f9b5-4e9c-82fa-2467c32b4712 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:21:03.729181 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-a16847cf-f9b5-4e9c-82fa-2467c32b4712 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 257e78c5-4e3b-4ab7-a406-3260323d6657] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:21:03.735896 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a16847cf-f9b5-4e9c-82fa-2467c32b4712 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:21:03.740649 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a16847cf-f9b5-4e9c-82fa-2467c32b4712 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:21:03.740649 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a16847cf-f9b5-4e9c-82fa-2467c32b4712 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:21:03.740649 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a16847cf-f9b5-4e9c-82fa-2467c32b4712 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:21:03.877737 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-a16847cf-f9b5-4e9c-82fa-2467c32b4712 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:21:03.885599 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-a16847cf-f9b5-4e9c-82fa-2467c32b4712 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657" status: 200 len: 1367 microversion: 2.1 time: 0.161656 Aug 03 19:21:03.886179 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 474/945] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:21:03 2022] GET /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:21:04.906818 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-45530fa0-d1ef-435f-a43c-ead565906a48 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:21:04.907472 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-45530fa0-d1ef-435f-a43c-ead565906a48 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 257e78c5-4e3b-4ab7-a406-3260323d6657] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:21:04.914257 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-45530fa0-d1ef-435f-a43c-ead565906a48 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:21:04.914702 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-45530fa0-d1ef-435f-a43c-ead565906a48 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:21:04.915514 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-45530fa0-d1ef-435f-a43c-ead565906a48 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:21:04.915956 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-45530fa0-d1ef-435f-a43c-ead565906a48 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:21:05.052600 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-45530fa0-d1ef-435f-a43c-ead565906a48 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:21:05.061549 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-45530fa0-d1ef-435f-a43c-ead565906a48 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657" status: 200 len: 1557 microversion: 2.1 time: 0.157965 Aug 03 19:21:05.062141 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 472/946] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:21:04 2022] GET /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657 => generated 1557 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:21:05.082170 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-84283f1e-7c07-4062-8d17-f30875973268 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:21:05.082718 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-84283f1e-7c07-4062-8d17-f30875973268 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 257e78c5-4e3b-4ab7-a406-3260323d6657] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:21:05.089133 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-84283f1e-7c07-4062-8d17-f30875973268 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:21:05.089594 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-84283f1e-7c07-4062-8d17-f30875973268 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:21:05.090322 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-84283f1e-7c07-4062-8d17-f30875973268 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:21:05.090749 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-84283f1e-7c07-4062-8d17-f30875973268 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:21:05.167983 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-84283f1e-7c07-4062-8d17-f30875973268 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089663 Aug 03 19:21:05.168584 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 475/947] 10.222.0.77 () {58 vars in 1275 bytes} [Wed Aug 3 19:21:05 2022] GET /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:21:06.193427 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-133bbfe4-396c-423d-b67c-e6557331c530 req-c7e5ca47-4e2d-4464-a150-a025abf9b1cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "257e78c5-4e3b-4ab7-a406-3260323d6657", "tag": "9f2808c4-8550-4e62-bf08-d23c1047d90c"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:21:06.207842 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-133bbfe4-396c-423d-b67c-e6557331c530 req-c7e5ca47-4e2d-4464-a150-a025abf9b1cc service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:21:06.208409 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-133bbfe4-396c-423d-b67c-e6557331c530 req-c7e5ca47-4e2d-4464-a150-a025abf9b1cc service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:21:06.222592 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-133bbfe4-396c-423d-b67c-e6557331c530 req-c7e5ca47-4e2d-4464-a150-a025abf9b1cc service nova] Creating event network-changed:9f2808c4-8550-4e62-bf08-d23c1047d90c for instance 257e78c5-4e3b-4ab7-a406-3260323d6657 on hv-cinder-85202 Aug 03 19:21:06.228299 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-133bbfe4-396c-423d-b67c-e6557331c530 req-c7e5ca47-4e2d-4464-a150-a025abf9b1cc service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041530 Aug 03 19:21:06.229270 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 473/948] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:21:30.324611 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 19:21:30.325232 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Wed Aug 3 19:21:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 19:22:21.306534 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:22:21.307572 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=36 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:22:21.312084 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-655a2e6f-c302-4eb2-82ab-627d8fa1e379 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:22:21.312572 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-655a2e6f-c302-4eb2-82ab-627d8fa1e379 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 257e78c5-4e3b-4ab7-a406-3260323d6657] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:22:21.318458 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-655a2e6f-c302-4eb2-82ab-627d8fa1e379 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:21.322364 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-655a2e6f-c302-4eb2-82ab-627d8fa1e379 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:21.322364 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-655a2e6f-c302-4eb2-82ab-627d8fa1e379 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:21.322364 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-655a2e6f-c302-4eb2-82ab-627d8fa1e379 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:21.344738 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-655a2e6f-c302-4eb2-82ab-627d8fa1e379 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657/ips" status: 200 len: 148 microversion: 2.1 time: 0.040017 Aug 03 19:22:21.345298 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 476/949] 10.222.0.77 () {58 vars in 1248 bytes} [Wed Aug 3 19:22:21 2022] GET /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657/ips => generated 148 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:22:21.354699 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:22:21.355480 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=46 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:22:21.359755 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-550075e5-c3cb-4f3f-88f3-3ec4d230164d tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68d20cfc-1c69-484e-ade4-fa534c8092b6"}} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:22:21.362207 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-550075e5-c3cb-4f3f-88f3-3ec4d230164d tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 257e78c5-4e3b-4ab7-a406-3260323d6657] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:22:21.368401 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-550075e5-c3cb-4f3f-88f3-3ec4d230164d tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:21.368849 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-550075e5-c3cb-4f3f-88f3-3ec4d230164d tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:21.369621 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-550075e5-c3cb-4f3f-88f3-3ec4d230164d tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:21.370059 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-550075e5-c3cb-4f3f-88f3-3ec4d230164d tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:21.455571 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.wsgi [None req-550075e5-c3cb-4f3f-88f3-3ec4d230164d tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] HTTP exception thrown: Invalid volume: volume 68d20cfc-1c69-484e-ade4-fa534c8092b6 is already attached to instances: 935a7612-a68e-4af7-a688-c94efb1f2676 Aug 03 19:22:21.457299 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-550075e5-c3cb-4f3f-88f3-3ec4d230164d tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Request method failure captured: Aug 03 19:22:21.457299 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: request: POST /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657/os-volume_attachments HTTP/1.1 Aug 03 19:22:21.457299 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept: application/json Aug 03 19:22:21.457299 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept-Encoding: identity Aug 03 19:22:21.457299 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Connection: close Aug 03 19:22:21.457299 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Length: 74 Aug 03 19:22:21.457299 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Type: application/json Aug 03 19:22:21.457299 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Host: 10.222.0.77 Aug 03 19:22:21.457299 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Openstack-System-Scope: None Aug 03 19:22:21.457299 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: User-Agent: python-urllib3/1.26.11 Aug 03 19:22:21.457299 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Auth-Token: gAAAAABi6soo3tVsyMpp4Q5BeVYgBkb-ZmSXfFqqDLxngfO69yiJ0ybu4b_gQBD6U7zMaZpKagPnF0tkOMv2DMg2Ki8vJ6bAkRfUIOgz6V1xoe8gX_F1YIssVOFX-QTa-WpQkCCkJJtYSX1EJo1Xmv5e_ntC-Qe1WtL2fOzOa0FpdkQ5uZgdkSk Aug 03 19:22:21.457299 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Id: None Aug 03 19:22:21.457299 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Name: None Aug 03 19:22:21.457299 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Identity-Status: Confirmed Aug 03 19:22:21.457299 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Is-Admin-Project: True Aug 03 19:22:21.457299 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Id: default Aug 03 19:22:21.457299 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Name: Default Aug 03 19:22:21.457299 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Id: e02e6595d2284de190bb759806ca02f6 Aug 03 19:22:21.457299 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Name: tempest-AttachVolumeNegativeTest-1363049785 Aug 03 19:22:21.457299 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Role: reader,member Aug 03 19:22:21.457299 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Roles: reader,member Aug 03 19:22:21.459075 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_e02e6595d2284de190bb759806ca02f6", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/e02e6595d2284de190bb759806ca02f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/e02e6595d2284de190bb759806ca02f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/e02e6595d2284de190bb759806ca02f6"}]}] Aug 03 19:22:21.459075 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant: tempest-AttachVolumeNegativeTest-1363049785 Aug 03 19:22:21.459075 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Id: e02e6595d2284de190bb759806ca02f6 Aug 03 19:22:21.459075 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1363049785 Aug 03 19:22:21.459075 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User: tempest-AttachVolumeNegativeTest-1363049785-project Aug 03 19:22:21.459075 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Id: default Aug 03 19:22:21.459075 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Name: Default Aug 03 19:22:21.459075 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Id: 32425eddf65f477db53594f7d4b447e2 Aug 03 19:22:21.459075 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Name: tempest-AttachVolumeNegativeTest-1363049785-project Aug 03 19:22:21.459075 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Aug 03 19:22:21.459075 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: {"volumeAttachment": {"volumeId": "68d20cfc-1c69-484e-ade4-fa534c8092b6"}} Aug 03 19:22:21.459075 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: method: > Aug 03 19:22:21.460186 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: exception: Invalid volume: volume 68d20cfc-1c69-484e-ade4-fa534c8092b6 is already attached to instances: 935a7612-a68e-4af7-a688-c94efb1f2676 Aug 03 19:22:21.460186 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: action_args: {'server_id': '257e78c5-4e3b-4ab7-a406-3260323d6657', 'body': {'volumeAttachment': {'volumeId': '68d20cfc-1c69-484e-ade4-fa534c8092b6'}}} Aug 03 19:22:21.460186 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:22:21.460186 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:22:21.460186 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 03 19:22:21.460186 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 03 19:22:21.460186 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 19:22:21.460186 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 19:22:21.460186 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 03 19:22:21.460186 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 19:22:21.460186 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 03 19:22:21.460186 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 03 19:22:21.460186 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 03 19:22:21.460186 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 03 19:22:21.460186 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 68d20cfc-1c69-484e-ade4-fa534c8092b6 is already attached to instances: 935a7612-a68e-4af7-a688-c94efb1f2676 Aug 03 19:22:21.460186 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:22:21.460186 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:22:21.460186 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:22:21.460186 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:22:21.461518 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:22:21.461518 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:22:21.461518 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:22:21.461518 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:22:21.461518 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:22:21.461518 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:22:21.461518 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 19:22:21.461518 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 19:22:21.461518 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 19:22:21.461518 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 19:22:21.461518 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 19:22:21.461518 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 19:22:21.461518 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 03 19:22:21.461518 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 03 19:22:21.461518 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 68d20cfc-1c69-484e-ade4-fa534c8092b6 is already attached to instances: 935a7612-a68e-4af7-a688-c94efb1f2676 Aug 03 19:22:21.461518 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:22:21.461518 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:22:21.461518 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:22:21.461518 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:22:21.461518 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:22:21.466117 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:22:21.466117 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:22:21.466117 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:22:21.466117 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 68d20cfc-1c69-484e-ade4-fa534c8092b6 is already attached to instances: 935a7612-a68e-4af7-a688-c94efb1f2676 Aug 03 19:22:21.466117 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:22:21.466117 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-550075e5-c3cb-4f3f-88f3-3ec4d230164d tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Returning 400 to user: Invalid volume: volume 68d20cfc-1c69-484e-ade4-fa534c8092b6 is already attached to instances: 935a7612-a68e-4af7-a688-c94efb1f2676 {{(pid=118302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:22:21.466117 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-550075e5-c3cb-4f3f-88f3-3ec4d230164d tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "POST /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106178 Aug 03 19:22:21.466117 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 474/950] 10.222.0.77 () {60 vars in 1323 bytes} [Wed Aug 3 19:22:21 2022] POST /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 19:22:21.468285 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-b3a89a63-6d75-4747-910f-1ad6c6f03e14 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:22:21.468775 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-b3a89a63-6d75-4747-910f-1ad6c6f03e14 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 257e78c5-4e3b-4ab7-a406-3260323d6657] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:22:21.475653 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b3a89a63-6d75-4747-910f-1ad6c6f03e14 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:21.476244 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b3a89a63-6d75-4747-910f-1ad6c6f03e14 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:21.477003 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b3a89a63-6d75-4747-910f-1ad6c6f03e14 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:21.477429 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-b3a89a63-6d75-4747-910f-1ad6c6f03e14 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:21.505351 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-b3a89a63-6d75-4747-910f-1ad6c6f03e14 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 257e78c5-4e3b-4ab7-a406-3260323d6657] Going to try to terminate instance {{(pid=118303) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 19:22:21.724289 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-b3a89a63-6d75-4747-910f-1ad6c6f03e14 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "DELETE /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657" status: 204 len: 0 microversion: 2.1 time: 0.260267 Aug 03 19:22:21.725545 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 477/951] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 3 19:22:21 2022] DELETE /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 19:22:21.738102 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-6facc373-78ea-4491-906d-912d9c963daf tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:22:21.738773 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-6facc373-78ea-4491-906d-912d9c963daf tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 257e78c5-4e3b-4ab7-a406-3260323d6657] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:22:21.745032 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-6facc373-78ea-4491-906d-912d9c963daf tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:21.745486 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-6facc373-78ea-4491-906d-912d9c963daf tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:21.746254 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-6facc373-78ea-4491-906d-912d9c963daf tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:21.746695 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-6facc373-78ea-4491-906d-912d9c963daf tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:21.883227 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-6facc373-78ea-4491-906d-912d9c963daf tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:22:21.890890 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-6facc373-78ea-4491-906d-912d9c963daf tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657" status: 200 len: 1680 microversion: 2.1 time: 0.156813 Aug 03 19:22:21.891479 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 475/952] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:22:21 2022] GET /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:22:22.913627 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-e4843523-cc84-42e6-afd3-91b4182e0a8f tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:22:22.914353 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-e4843523-cc84-42e6-afd3-91b4182e0a8f tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 257e78c5-4e3b-4ab7-a406-3260323d6657] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:22:22.921711 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e4843523-cc84-42e6-afd3-91b4182e0a8f tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:22.922157 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e4843523-cc84-42e6-afd3-91b4182e0a8f tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:22.922919 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e4843523-cc84-42e6-afd3-91b4182e0a8f tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:22.923449 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e4843523-cc84-42e6-afd3-91b4182e0a8f tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:23.060964 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-e4843523-cc84-42e6-afd3-91b4182e0a8f tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:22:23.068540 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-e4843523-cc84-42e6-afd3-91b4182e0a8f tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657" status: 200 len: 1680 microversion: 2.1 time: 0.159121 Aug 03 19:22:23.069102 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 478/953] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:22:22 2022] GET /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:22:24.089863 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-9898a36d-3221-4903-a8bf-45146df9e724 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:22:24.090417 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-9898a36d-3221-4903-a8bf-45146df9e724 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 257e78c5-4e3b-4ab7-a406-3260323d6657] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:22:24.097373 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9898a36d-3221-4903-a8bf-45146df9e724 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:24.097823 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9898a36d-3221-4903-a8bf-45146df9e724 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:24.098590 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9898a36d-3221-4903-a8bf-45146df9e724 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:24.099048 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9898a36d-3221-4903-a8bf-45146df9e724 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:24.162477 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-9898a36d-3221-4903-a8bf-45146df9e724 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:22:24.171202 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-9898a36d-3221-4903-a8bf-45146df9e724 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657" status: 200 len: 1612 microversion: 2.1 time: 0.085287 Aug 03 19:22:24.171764 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 476/954] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:22:24 2022] GET /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657 => generated 1612 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:22:24.266130 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [req-8f14dbe5-301e-4f0b-9677-06973d0b9e36 req-ce3205e4-240b-4734-8e10-103dd22f17a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "257e78c5-4e3b-4ab7-a406-3260323d6657", "name": "network-vif-deleted", "tag": "9f2808c4-8550-4e62-bf08-d23c1047d90c"}]} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:22:24.277309 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-8f14dbe5-301e-4f0b-9677-06973d0b9e36 req-ce3205e4-240b-4734-8e10-103dd22f17a8 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:24.277749 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-8f14dbe5-301e-4f0b-9677-06973d0b9e36 req-ce3205e4-240b-4734-8e10-103dd22f17a8 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:24.289024 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.compute.server_external_events [req-8f14dbe5-301e-4f0b-9677-06973d0b9e36 req-ce3205e4-240b-4734-8e10-103dd22f17a8 service nova] Creating event network-vif-deleted:9f2808c4-8550-4e62-bf08-d23c1047d90c for instance 257e78c5-4e3b-4ab7-a406-3260323d6657 on hv-cinder-85202 Aug 03 19:22:24.295589 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [req-8f14dbe5-301e-4f0b-9677-06973d0b9e36 req-ce3205e4-240b-4734-8e10-103dd22f17a8 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031635 Aug 03 19:22:24.295982 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 479/955] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:22:25.192657 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-327c5ee8-e643-47cc-b3d3-268ff581fb32 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:22:25.193272 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-327c5ee8-e643-47cc-b3d3-268ff581fb32 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 257e78c5-4e3b-4ab7-a406-3260323d6657] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:22:25.199790 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-327c5ee8-e643-47cc-b3d3-268ff581fb32 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:25.200249 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-327c5ee8-e643-47cc-b3d3-268ff581fb32 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:25.201560 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-327c5ee8-e643-47cc-b3d3-268ff581fb32 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:25.202113 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-327c5ee8-e643-47cc-b3d3-268ff581fb32 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:25.236830 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-327c5ee8-e643-47cc-b3d3-268ff581fb32 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:25.237293 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-327c5ee8-e643-47cc-b3d3-268ff581fb32 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:25.237754 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.objects.instance [None req-327c5ee8-e643-47cc-b3d3-268ff581fb32 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lazy-loading 'fault' on Instance uuid 257e78c5-4e3b-4ab7-a406-3260323d6657 {{(pid=118302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:22:25.283871 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-327c5ee8-e643-47cc-b3d3-268ff581fb32 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:22:25.290712 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-327c5ee8-e643-47cc-b3d3-268ff581fb32 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657" status: 200 len: 1331 microversion: 2.1 time: 0.101977 Aug 03 19:22:25.291369 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 477/956] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:22:25 2022] GET /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657 => generated 1331 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:22:26.313109 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-493299da-1b2a-46a0-bdb3-93bdee5f7cdb tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:22:26.313802 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-493299da-1b2a-46a0-bdb3-93bdee5f7cdb tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 257e78c5-4e3b-4ab7-a406-3260323d6657] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:22:26.320065 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-493299da-1b2a-46a0-bdb3-93bdee5f7cdb tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:26.320680 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-493299da-1b2a-46a0-bdb3-93bdee5f7cdb tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:26.321698 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-493299da-1b2a-46a0-bdb3-93bdee5f7cdb tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:26.322401 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-493299da-1b2a-46a0-bdb3-93bdee5f7cdb tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:26.336378 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.wsgi [None req-493299da-1b2a-46a0-bdb3-93bdee5f7cdb tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] HTTP exception thrown: Instance 257e78c5-4e3b-4ab7-a406-3260323d6657 could not be found. Aug 03 19:22:26.337961 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-493299da-1b2a-46a0-bdb3-93bdee5f7cdb tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Request method failure captured: Aug 03 19:22:26.337961 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: request: GET /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657 HTTP/1.1 Aug 03 19:22:26.337961 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept: application/json Aug 03 19:22:26.337961 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept-Encoding: identity Aug 03 19:22:26.337961 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Connection: close Aug 03 19:22:26.337961 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Length: 0 Aug 03 19:22:26.337961 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Type: application/json Aug 03 19:22:26.337961 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Host: 10.222.0.77 Aug 03 19:22:26.337961 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Openstack-System-Scope: None Aug 03 19:22:26.337961 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: User-Agent: python-urllib3/1.26.11 Aug 03 19:22:26.337961 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Auth-Token: gAAAAABi6soo3tVsyMpp4Q5BeVYgBkb-ZmSXfFqqDLxngfO69yiJ0ybu4b_gQBD6U7zMaZpKagPnF0tkOMv2DMg2Ki8vJ6bAkRfUIOgz6V1xoe8gX_F1YIssVOFX-QTa-WpQkCCkJJtYSX1EJo1Xmv5e_ntC-Qe1WtL2fOzOa0FpdkQ5uZgdkSk Aug 03 19:22:26.337961 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Id: None Aug 03 19:22:26.337961 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Name: None Aug 03 19:22:26.337961 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Identity-Status: Confirmed Aug 03 19:22:26.337961 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Is-Admin-Project: True Aug 03 19:22:26.337961 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Id: default Aug 03 19:22:26.337961 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Name: Default Aug 03 19:22:26.337961 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Id: e02e6595d2284de190bb759806ca02f6 Aug 03 19:22:26.337961 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Name: tempest-AttachVolumeNegativeTest-1363049785 Aug 03 19:22:26.337961 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Role: reader,member Aug 03 19:22:26.337961 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Roles: reader,member Aug 03 19:22:26.339665 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_e02e6595d2284de190bb759806ca02f6", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/e02e6595d2284de190bb759806ca02f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/e02e6595d2284de190bb759806ca02f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/e02e6595d2284de190bb759806ca02f6"}]}] Aug 03 19:22:26.339665 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant: tempest-AttachVolumeNegativeTest-1363049785 Aug 03 19:22:26.339665 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Id: e02e6595d2284de190bb759806ca02f6 Aug 03 19:22:26.339665 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1363049785 Aug 03 19:22:26.339665 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User: tempest-AttachVolumeNegativeTest-1363049785-project Aug 03 19:22:26.339665 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Id: default Aug 03 19:22:26.339665 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Name: Default Aug 03 19:22:26.339665 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Id: 32425eddf65f477db53594f7d4b447e2 Aug 03 19:22:26.339665 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Name: tempest-AttachVolumeNegativeTest-1363049785-project Aug 03 19:22:26.339665 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: method: > Aug 03 19:22:26.339665 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: exception: Instance 257e78c5-4e3b-4ab7-a406-3260323d6657 could not be found. Aug 03 19:22:26.339665 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: action_args: {'id': '257e78c5-4e3b-4ab7-a406-3260323d6657'} Aug 03 19:22:26.340623 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:22:26.340623 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:22:26.340623 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:22:26.340623 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:22:26.340623 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:22:26.340623 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:22:26.340623 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:22:26.340623 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:22:26.340623 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:22:26.340623 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:22:26.340623 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 257e78c5-4e3b-4ab7-a406-3260323d6657 could not be found. Aug 03 19:22:26.340623 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:22:26.340623 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:22:26.340623 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:22:26.340623 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:22:26.340623 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:22:26.340623 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:22:26.340623 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:22:26.340623 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:22:26.340623 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:22:26.343094 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:22:26.343094 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:22:26.343094 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:22:26.343094 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:22:26.343094 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:22:26.343094 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:22:26.343094 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:22:26.343094 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 257e78c5-4e3b-4ab7-a406-3260323d6657 could not be found. Aug 03 19:22:26.343094 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:22:26.343094 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:22:26.343094 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:22:26.343094 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:22:26.343094 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:22:26.343094 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:22:26.343094 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:22:26.343094 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:22:26.343094 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 257e78c5-4e3b-4ab7-a406-3260323d6657 could not be found. Aug 03 19:22:26.343094 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:22:26.344621 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-493299da-1b2a-46a0-bdb3-93bdee5f7cdb tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Returning 404 to user: Instance 257e78c5-4e3b-4ab7-a406-3260323d6657 could not be found. {{(pid=118303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:22:26.344621 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-493299da-1b2a-46a0-bdb3-93bdee5f7cdb tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657" status: 404 len: 111 microversion: 2.1 time: 0.031337 Aug 03 19:22:26.344621 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 480/957] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:22:26 2022] GET /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:22:26.349197 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-565c5197-7d69-4f08-85a1-60b405f065d3 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '.version_select at 0x7f478630bd30>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:22:26.435269 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-565c5197-7d69-4f08-85a1-60b405f065d3 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-545347306" status: 202 len: 0 microversion: 2.1 time: 0.089680 Aug 03 19:22:26.435898 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 478/958] 10.222.0.77 () {58 vars in 1218 bytes} [Wed Aug 3 19:22:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-545347306 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 19:22:27.227840 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-343c6358-4d8e-48ab-9281-7062c3529c4c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:22:27.228359 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-343c6358-4d8e-48ab-9281-7062c3529c4c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 935a7612-a68e-4af7-a688-c94efb1f2676] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:22:27.235060 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-343c6358-4d8e-48ab-9281-7062c3529c4c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:27.235513 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-343c6358-4d8e-48ab-9281-7062c3529c4c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:27.236310 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-343c6358-4d8e-48ab-9281-7062c3529c4c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:27.236850 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-343c6358-4d8e-48ab-9281-7062c3529c4c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:27.320732 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.objects.instance [None req-343c6358-4d8e-48ab-9281-7062c3529c4c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lazy-loading 'services' on Instance uuid 935a7612-a68e-4af7-a688-c94efb1f2676 {{(pid=118303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:22:27.478034 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-343c6358-4d8e-48ab-9281-7062c3529c4c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "DELETE /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676/os-volume_attachments/68d20cfc-1c69-484e-ade4-fa534c8092b6" status: 202 len: 0 microversion: 2.1 time: 0.253903 Aug 03 19:22:27.478639 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 481/959] 10.222.0.77 () {58 vars in 1416 bytes} [Wed Aug 3 19:22:27 2022] DELETE /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676/os-volume_attachments/68d20cfc-1c69-484e-ade4-fa534c8092b6 => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 19:22:27.488307 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-58b5c78f-2f0c-48a4-aba3-5c68c3ed753a tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:22:27.490471 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-58b5c78f-2f0c-48a4-aba3-5c68c3ed753a tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 935a7612-a68e-4af7-a688-c94efb1f2676] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:22:27.497879 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-58b5c78f-2f0c-48a4-aba3-5c68c3ed753a tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:27.498387 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-58b5c78f-2f0c-48a4-aba3-5c68c3ed753a tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:27.499247 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-58b5c78f-2f0c-48a4-aba3-5c68c3ed753a tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:27.499688 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-58b5c78f-2f0c-48a4-aba3-5c68c3ed753a tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:27.531505 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-58b5c78f-2f0c-48a4-aba3-5c68c3ed753a tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047345 Aug 03 19:22:27.532253 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 479/960] 10.222.0.77 () {58 vars in 1302 bytes} [Wed Aug 3 19:22:27 2022] GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 19:22:28.545906 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-ff69766b-558b-4c38-a88a-cb54a8333f7e tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:22:28.548271 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-ff69766b-558b-4c38-a88a-cb54a8333f7e tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 935a7612-a68e-4af7-a688-c94efb1f2676] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:22:28.554510 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ff69766b-558b-4c38-a88a-cb54a8333f7e tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:28.555166 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ff69766b-558b-4c38-a88a-cb54a8333f7e tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:28.555823 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ff69766b-558b-4c38-a88a-cb54a8333f7e tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:28.556254 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ff69766b-558b-4c38-a88a-cb54a8333f7e tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:28.588386 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-ff69766b-558b-4c38-a88a-cb54a8333f7e tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047760 Aug 03 19:22:28.588953 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 482/961] 10.222.0.77 () {58 vars in 1302 bytes} [Wed Aug 3 19:22:28 2022] GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 19:22:29.600975 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-2ef64334-f495-4969-a8af-55d44354bb85 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:22:29.603090 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-2ef64334-f495-4969-a8af-55d44354bb85 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 935a7612-a68e-4af7-a688-c94efb1f2676] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:22:29.610237 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2ef64334-f495-4969-a8af-55d44354bb85 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:29.610684 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2ef64334-f495-4969-a8af-55d44354bb85 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:29.611480 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2ef64334-f495-4969-a8af-55d44354bb85 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:29.611922 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2ef64334-f495-4969-a8af-55d44354bb85 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:29.640631 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-2ef64334-f495-4969-a8af-55d44354bb85 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043703 Aug 03 19:22:29.641181 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 480/962] 10.222.0.77 () {58 vars in 1302 bytes} [Wed Aug 3 19:22:29 2022] GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 19:22:29.704842 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-c0464a66-67f0-4f53-8dd1-2bf8fec4357d tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:22:29.705392 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-c0464a66-67f0-4f53-8dd1-2bf8fec4357d tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 935a7612-a68e-4af7-a688-c94efb1f2676] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:22:29.711825 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c0464a66-67f0-4f53-8dd1-2bf8fec4357d tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:29.712266 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c0464a66-67f0-4f53-8dd1-2bf8fec4357d tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:29.713030 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c0464a66-67f0-4f53-8dd1-2bf8fec4357d tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:29.713465 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c0464a66-67f0-4f53-8dd1-2bf8fec4357d tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:29.739336 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-c0464a66-67f0-4f53-8dd1-2bf8fec4357d tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 935a7612-a68e-4af7-a688-c94efb1f2676] Going to try to terminate instance {{(pid=118303) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 19:22:30.004557 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-c0464a66-67f0-4f53-8dd1-2bf8fec4357d tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "DELETE /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676" status: 204 len: 0 microversion: 2.1 time: 0.303320 Aug 03 19:22:30.005236 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 483/963] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 3 19:22:29 2022] DELETE /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 19:22:30.018661 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-78e666de-ef68-4d42-b237-e3fd9bce3ed4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:22:30.019308 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-78e666de-ef68-4d42-b237-e3fd9bce3ed4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 935a7612-a68e-4af7-a688-c94efb1f2676] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:22:30.025629 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-78e666de-ef68-4d42-b237-e3fd9bce3ed4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:30.026083 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-78e666de-ef68-4d42-b237-e3fd9bce3ed4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:30.026842 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-78e666de-ef68-4d42-b237-e3fd9bce3ed4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:30.027303 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-78e666de-ef68-4d42-b237-e3fd9bce3ed4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:30.164749 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-78e666de-ef68-4d42-b237-e3fd9bce3ed4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:22:30.172382 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-78e666de-ef68-4d42-b237-e3fd9bce3ed4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676" status: 200 len: 1679 microversion: 2.1 time: 0.157510 Aug 03 19:22:30.172949 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 481/964] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:22:30 2022] GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:22:31.194222 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-aa63bd01-b5d9-4aa8-9802-211ddf1a48c2 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:22:31.194924 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-aa63bd01-b5d9-4aa8-9802-211ddf1a48c2 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 935a7612-a68e-4af7-a688-c94efb1f2676] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:22:31.202219 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-aa63bd01-b5d9-4aa8-9802-211ddf1a48c2 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:31.202668 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-aa63bd01-b5d9-4aa8-9802-211ddf1a48c2 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:31.203457 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-aa63bd01-b5d9-4aa8-9802-211ddf1a48c2 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:31.203916 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-aa63bd01-b5d9-4aa8-9802-211ddf1a48c2 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:31.340421 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-aa63bd01-b5d9-4aa8-9802-211ddf1a48c2 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:22:31.347870 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-aa63bd01-b5d9-4aa8-9802-211ddf1a48c2 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676" status: 200 len: 1679 microversion: 2.1 time: 0.157910 Aug 03 19:22:31.348424 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 484/965] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:22:31 2022] GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:22:32.369018 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-41e63534-8a35-481f-a72d-d94633963879 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:22:32.369654 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-41e63534-8a35-481f-a72d-d94633963879 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 935a7612-a68e-4af7-a688-c94efb1f2676] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:22:32.378442 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-41e63534-8a35-481f-a72d-d94633963879 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:32.379172 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-41e63534-8a35-481f-a72d-d94633963879 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:32.380064 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-41e63534-8a35-481f-a72d-d94633963879 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:32.380535 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-41e63534-8a35-481f-a72d-d94633963879 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:32.450287 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-41e63534-8a35-481f-a72d-d94633963879 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:22:32.458128 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-41e63534-8a35-481f-a72d-d94633963879 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676" status: 200 len: 1613 microversion: 2.1 time: 0.093057 Aug 03 19:22:32.458700 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 482/966] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:22:32 2022] GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676 => generated 1613 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:22:32.684162 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [req-df88db3b-be4b-47ca-8175-2ec5eb0b8bcf req-744848fb-ec84-474d-8b67-ffd7fdbf03ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "935a7612-a68e-4af7-a688-c94efb1f2676", "name": "network-vif-deleted", "tag": "bf943d42-e379-4c01-89fb-856616c1346c"}]} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:22:32.694124 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-df88db3b-be4b-47ca-8175-2ec5eb0b8bcf req-744848fb-ec84-474d-8b67-ffd7fdbf03ad service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:32.697155 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-df88db3b-be4b-47ca-8175-2ec5eb0b8bcf req-744848fb-ec84-474d-8b67-ffd7fdbf03ad service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:32.708533 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.compute.server_external_events [req-df88db3b-be4b-47ca-8175-2ec5eb0b8bcf req-744848fb-ec84-474d-8b67-ffd7fdbf03ad service nova] Creating event network-vif-deleted:bf943d42-e379-4c01-89fb-856616c1346c for instance 935a7612-a68e-4af7-a688-c94efb1f2676 on hv-cinder-85202 Aug 03 19:22:32.711205 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [req-df88db3b-be4b-47ca-8175-2ec5eb0b8bcf req-744848fb-ec84-474d-8b67-ffd7fdbf03ad service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031073 Aug 03 19:22:32.711859 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 485/967] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:22:33.479336 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-8984ebfb-31d7-4ea0-adaf-9333e39f9a41 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:22:33.479997 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-8984ebfb-31d7-4ea0-adaf-9333e39f9a41 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 935a7612-a68e-4af7-a688-c94efb1f2676] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:22:33.487800 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8984ebfb-31d7-4ea0-adaf-9333e39f9a41 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:33.488252 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8984ebfb-31d7-4ea0-adaf-9333e39f9a41 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:33.489038 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8984ebfb-31d7-4ea0-adaf-9333e39f9a41 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:33.489472 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8984ebfb-31d7-4ea0-adaf-9333e39f9a41 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:33.527361 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8984ebfb-31d7-4ea0-adaf-9333e39f9a41 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:33.528157 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8984ebfb-31d7-4ea0-adaf-9333e39f9a41 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:33.529282 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.objects.instance [None req-8984ebfb-31d7-4ea0-adaf-9333e39f9a41 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lazy-loading 'fault' on Instance uuid 935a7612-a68e-4af7-a688-c94efb1f2676 {{(pid=118302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:22:33.578591 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-8984ebfb-31d7-4ea0-adaf-9333e39f9a41 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:22:33.584484 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-8984ebfb-31d7-4ea0-adaf-9333e39f9a41 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676" status: 200 len: 1331 microversion: 2.1 time: 0.109225 Aug 03 19:22:33.585153 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 483/968] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:22:33 2022] GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676 => generated 1331 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:22:34.607488 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-81cefed6-b2d3-4de9-825b-cf3f8d500d76 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:22:34.608174 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-81cefed6-b2d3-4de9-825b-cf3f8d500d76 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 935a7612-a68e-4af7-a688-c94efb1f2676] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:22:34.614656 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-81cefed6-b2d3-4de9-825b-cf3f8d500d76 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:34.615144 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-81cefed6-b2d3-4de9-825b-cf3f8d500d76 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:34.615913 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-81cefed6-b2d3-4de9-825b-cf3f8d500d76 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:34.616353 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-81cefed6-b2d3-4de9-825b-cf3f8d500d76 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:34.630171 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.wsgi [None req-81cefed6-b2d3-4de9-825b-cf3f8d500d76 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] HTTP exception thrown: Instance 935a7612-a68e-4af7-a688-c94efb1f2676 could not be found. Aug 03 19:22:34.631803 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-81cefed6-b2d3-4de9-825b-cf3f8d500d76 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Request method failure captured: Aug 03 19:22:34.631803 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: request: GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676 HTTP/1.1 Aug 03 19:22:34.631803 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept: application/json Aug 03 19:22:34.631803 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept-Encoding: identity Aug 03 19:22:34.631803 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Connection: close Aug 03 19:22:34.631803 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Length: 0 Aug 03 19:22:34.631803 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Type: application/json Aug 03 19:22:34.631803 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Host: 10.222.0.77 Aug 03 19:22:34.631803 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Openstack-System-Scope: None Aug 03 19:22:34.631803 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: User-Agent: python-urllib3/1.26.11 Aug 03 19:22:34.631803 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Auth-Token: gAAAAABi6soo3tVsyMpp4Q5BeVYgBkb-ZmSXfFqqDLxngfO69yiJ0ybu4b_gQBD6U7zMaZpKagPnF0tkOMv2DMg2Ki8vJ6bAkRfUIOgz6V1xoe8gX_F1YIssVOFX-QTa-WpQkCCkJJtYSX1EJo1Xmv5e_ntC-Qe1WtL2fOzOa0FpdkQ5uZgdkSk Aug 03 19:22:34.631803 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Id: None Aug 03 19:22:34.631803 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Name: None Aug 03 19:22:34.631803 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Identity-Status: Confirmed Aug 03 19:22:34.631803 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Is-Admin-Project: True Aug 03 19:22:34.631803 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Id: default Aug 03 19:22:34.631803 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Name: Default Aug 03 19:22:34.631803 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Id: e02e6595d2284de190bb759806ca02f6 Aug 03 19:22:34.631803 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Name: tempest-AttachVolumeNegativeTest-1363049785 Aug 03 19:22:34.631803 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Role: reader,member Aug 03 19:22:34.631803 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Roles: reader,member Aug 03 19:22:34.633405 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_e02e6595d2284de190bb759806ca02f6", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/e02e6595d2284de190bb759806ca02f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/e02e6595d2284de190bb759806ca02f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/e02e6595d2284de190bb759806ca02f6"}]}] Aug 03 19:22:34.633405 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant: tempest-AttachVolumeNegativeTest-1363049785 Aug 03 19:22:34.633405 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Id: e02e6595d2284de190bb759806ca02f6 Aug 03 19:22:34.633405 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1363049785 Aug 03 19:22:34.633405 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User: tempest-AttachVolumeNegativeTest-1363049785-project Aug 03 19:22:34.633405 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Id: default Aug 03 19:22:34.633405 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Name: Default Aug 03 19:22:34.633405 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Id: 32425eddf65f477db53594f7d4b447e2 Aug 03 19:22:34.633405 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Name: tempest-AttachVolumeNegativeTest-1363049785-project Aug 03 19:22:34.633405 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: method: > Aug 03 19:22:34.633405 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: exception: Instance 935a7612-a68e-4af7-a688-c94efb1f2676 could not be found. Aug 03 19:22:34.633405 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: action_args: {'id': '935a7612-a68e-4af7-a688-c94efb1f2676'} Aug 03 19:22:34.634277 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:22:34.634277 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:22:34.634277 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:22:34.634277 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:22:34.634277 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:22:34.634277 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:22:34.634277 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:22:34.634277 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:22:34.634277 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:22:34.634277 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:22:34.634277 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 935a7612-a68e-4af7-a688-c94efb1f2676 could not be found. Aug 03 19:22:34.634277 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:22:34.634277 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:22:34.634277 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:22:34.634277 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:22:34.634277 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:22:34.634277 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:22:34.634277 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:22:34.634277 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:22:34.634277 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:22:34.635837 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:22:34.635837 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:22:34.635837 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:22:34.635837 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:22:34.635837 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:22:34.635837 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:22:34.635837 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:22:34.635837 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 935a7612-a68e-4af7-a688-c94efb1f2676 could not be found. Aug 03 19:22:34.635837 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:22:34.635837 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:22:34.635837 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:22:34.635837 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:22:34.635837 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:22:34.635837 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:22:34.635837 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:22:34.635837 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:22:34.635837 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 935a7612-a68e-4af7-a688-c94efb1f2676 could not be found. Aug 03 19:22:34.635837 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:22:34.637161 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-81cefed6-b2d3-4de9-825b-cf3f8d500d76 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Returning 404 to user: Instance 935a7612-a68e-4af7-a688-c94efb1f2676 could not be found. {{(pid=118303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:22:34.637161 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-81cefed6-b2d3-4de9-825b-cf3f8d500d76 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676" status: 404 len: 111 microversion: 2.1 time: 0.031182 Aug 03 19:22:34.637161 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 486/969] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:22:34 2022] GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:22:34.642085 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-ef6ee0f0-ee5e-475a-8882-52a22fc25c04 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '.version_select at 0x7f478627f280>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:22:34.714650 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-ef6ee0f0-ee5e-475a-8882-52a22fc25c04 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-161603596" status: 202 len: 0 microversion: 2.1 time: 0.076318 Aug 03 19:22:34.715269 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 484/970] 10.222.0.77 () {58 vars in 1218 bytes} [Wed Aug 3 19:22:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-161603596 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 19:22:35.473161 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-d12085c4-b4b6-45e4-a6dc-c4f9aaf23219 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Action: 'create', calling method: .version_select at 0x7f478615fe50>, body: {"keypair": {"name": "tempest-keypair-1314866662", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQrybckoo2XIJbXIfRaJa8R+kvWjNK32triru3eamfCct48PRYNiHa9FFb7CTcsndTt4qwxFqMFuvFFwZPNW/1hrvHVBmfMZ8yxINTut13CpnDdi3aB3n3D88Rp5wqgbQ=="}} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:22:35.488267 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.quota [None req-d12085c4-b4b6-45e4-a6dc-c4f9aaf23219 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Getting quotas for project e02e6595d2284de190bb759806ca02f6. Resources: {'key_pairs'} {{(pid=118303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:22:35.492059 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.quota [None req-d12085c4-b4b6-45e4-a6dc-c4f9aaf23219 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Getting quotas for user 32425eddf65f477db53594f7d4b447e2 and project e02e6595d2284de190bb759806ca02f6. Resources: {'key_pairs'} {{(pid=118303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:22:35.595468 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-d12085c4-b4b6-45e4-a6dc-c4f9aaf23219 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.125897 Aug 03 19:22:35.595971 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 487/971] 10.222.0.77 () {60 vars in 1159 bytes} [Wed Aug 3 19:22:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:22:37.645078 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-8a687175-efa2-4f99-8274-0c6a7bdc56c4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-957491678", "imageRef": "0b6be242-215e-4886-a0d2-b8d5f8ca623e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b27e972d-f40b-4fda-b5a4-b93304ec49ce"}], "security_groups": [{"name": "tempest-securitygroup--289675328"}], "key_name": "tempest-keypair-1314866662", "user_data": "}} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:22:37.752865 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.network.neutron [None req-8a687175-efa2-4f99-8274-0c6a7bdc56c4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] validate_networks() for [('b27e972d-f40b-4fda-b5a4-b93304ec49ce', None, None, None, None, None)] {{(pid=118302) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 19:22:38.387190 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-8a687175-efa2-4f99-8274-0c6a7bdc56c4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Flavor limits 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 19:22:38.387633 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-8a687175-efa2-4f99-8274-0c6a7bdc56c4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Image limits 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 19:22:38.388107 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-8a687175-efa2-4f99-8274-0c6a7bdc56c4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Flavor pref 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 19:22:38.388524 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-8a687175-efa2-4f99-8274-0c6a7bdc56c4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Image pref 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 19:22:38.389037 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-8a687175-efa2-4f99-8274-0c6a7bdc56c4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 19:22:38.397987 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8a687175-efa2-4f99-8274-0c6a7bdc56c4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:38.398440 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8a687175-efa2-4f99-8274-0c6a7bdc56c4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:38.399402 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8a687175-efa2-4f99-8274-0c6a7bdc56c4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:38.399846 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8a687175-efa2-4f99-8274-0c6a7bdc56c4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:38.418248 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.quota [None req-8a687175-efa2-4f99-8274-0c6a7bdc56c4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Getting quotas for project e02e6595d2284de190bb759806ca02f6. Resources: {'instances', 'cores', 'ram'} {{(pid=118302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:22:38.423591 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.quota [None req-8a687175-efa2-4f99-8274-0c6a7bdc56c4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Getting quotas for user 32425eddf65f477db53594f7d4b447e2 and project e02e6595d2284de190bb759806ca02f6. Resources: {'instances', 'cores', 'ram'} {{(pid=118302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:22:38.435051 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-8a687175-efa2-4f99-8274-0c6a7bdc56c4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Going to run 1 instances... {{(pid=118302) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 19:22:38.437510 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-8a687175-efa2-4f99-8274-0c6a7bdc56c4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 160754d3-09be-409f-acb5-7f7acc57bfc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0b6be242-215e-4886-a0d2-b8d5f8ca623e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 19:22:38.589443 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-8a687175-efa2-4f99-8274-0c6a7bdc56c4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.949086 Aug 03 19:22:38.590157 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 485/972] 10.222.0.77 () {60 vars in 1147 bytes} [Wed Aug 3 19:22:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 19:22:38.602479 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-3df6c083-d51e-47c7-a42f-ff217db4a81b tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:22:38.603128 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-3df6c083-d51e-47c7-a42f-ff217db4a81b tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 160754d3-09be-409f-acb5-7f7acc57bfc1] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:22:38.663653 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-3df6c083-d51e-47c7-a42f-ff217db4a81b tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:22:38.672109 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-3df6c083-d51e-47c7-a42f-ff217db4a81b tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1" status: 200 len: 1241 microversion: 2.1 time: 0.074065 Aug 03 19:22:38.672674 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 488/973] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:22:38 2022] GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1 => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:22:39.693392 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-e9df5e7a-ab25-4574-a5af-f349193c15ce tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:22:39.695890 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-e9df5e7a-ab25-4574-a5af-f349193c15ce tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 160754d3-09be-409f-acb5-7f7acc57bfc1] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:22:39.700217 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e9df5e7a-ab25-4574-a5af-f349193c15ce tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:39.700666 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e9df5e7a-ab25-4574-a5af-f349193c15ce tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:39.701434 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e9df5e7a-ab25-4574-a5af-f349193c15ce tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:39.701868 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e9df5e7a-ab25-4574-a5af-f349193c15ce tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:39.763930 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-e9df5e7a-ab25-4574-a5af-f349193c15ce tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:22:39.771327 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-e9df5e7a-ab25-4574-a5af-f349193c15ce tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1" status: 200 len: 1245 microversion: 2.1 time: 0.082344 Aug 03 19:22:39.771887 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 486/974] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:22:39 2022] GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:22:40.791907 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-ae181537-27e7-40f5-8192-f889cc76a170 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:22:40.792522 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-ae181537-27e7-40f5-8192-f889cc76a170 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 160754d3-09be-409f-acb5-7f7acc57bfc1] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:22:40.799212 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ae181537-27e7-40f5-8192-f889cc76a170 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:40.799659 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ae181537-27e7-40f5-8192-f889cc76a170 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:40.800422 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ae181537-27e7-40f5-8192-f889cc76a170 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:40.800857 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ae181537-27e7-40f5-8192-f889cc76a170 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:40.862186 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-ae181537-27e7-40f5-8192-f889cc76a170 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:22:40.869848 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-ae181537-27e7-40f5-8192-f889cc76a170 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1" status: 200 len: 1299 microversion: 2.1 time: 0.081801 Aug 03 19:22:40.870421 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 489/975] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:22:40 2022] GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1 => generated 1299 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:22:41.892458 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-69567ec4-1d7b-4b02-aa52-95d587131a90 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:22:41.893085 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-69567ec4-1d7b-4b02-aa52-95d587131a90 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 160754d3-09be-409f-acb5-7f7acc57bfc1] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:22:41.900634 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-69567ec4-1d7b-4b02-aa52-95d587131a90 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:41.901085 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-69567ec4-1d7b-4b02-aa52-95d587131a90 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:41.901865 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-69567ec4-1d7b-4b02-aa52-95d587131a90 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:41.902313 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-69567ec4-1d7b-4b02-aa52-95d587131a90 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:42.053197 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-69567ec4-1d7b-4b02-aa52-95d587131a90 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:22:42.061983 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-69567ec4-1d7b-4b02-aa52-95d587131a90 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1" status: 200 len: 1366 microversion: 2.1 time: 0.173888 Aug 03 19:22:42.062566 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 487/976] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:22:41 2022] GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:22:42.443275 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [req-1d6cbd37-0f1a-4a59-b2a8-4e0555f25bd3 req-aaa0ffce-ce70-47ca-b446-ef51349bfb0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "160754d3-09be-409f-acb5-7f7acc57bfc1", "tag": "5971c936-075c-46e2-bc75-d601969557dd"}]} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:22:42.457064 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-1d6cbd37-0f1a-4a59-b2a8-4e0555f25bd3 req-aaa0ffce-ce70-47ca-b446-ef51349bfb0b service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:42.457714 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-1d6cbd37-0f1a-4a59-b2a8-4e0555f25bd3 req-aaa0ffce-ce70-47ca-b446-ef51349bfb0b service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:42.470790 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.compute.server_external_events [req-1d6cbd37-0f1a-4a59-b2a8-4e0555f25bd3 req-aaa0ffce-ce70-47ca-b446-ef51349bfb0b service nova] Creating event network-changed:5971c936-075c-46e2-bc75-d601969557dd for instance 160754d3-09be-409f-acb5-7f7acc57bfc1 on hv-cinder-85202 Aug 03 19:22:42.476325 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [req-1d6cbd37-0f1a-4a59-b2a8-4e0555f25bd3 req-aaa0ffce-ce70-47ca-b446-ef51349bfb0b service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042431 Aug 03 19:22:42.477279 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 490/977] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:22:43.084300 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-1454414d-98ab-490f-8c9b-771ef7fe43ad tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:22:43.084964 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-1454414d-98ab-490f-8c9b-771ef7fe43ad tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 160754d3-09be-409f-acb5-7f7acc57bfc1] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:22:43.092298 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1454414d-98ab-490f-8c9b-771ef7fe43ad tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:43.093075 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1454414d-98ab-490f-8c9b-771ef7fe43ad tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:43.093909 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1454414d-98ab-490f-8c9b-771ef7fe43ad tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:43.094349 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1454414d-98ab-490f-8c9b-771ef7fe43ad tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:43.237984 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-1454414d-98ab-490f-8c9b-771ef7fe43ad tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:22:43.246637 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-1454414d-98ab-490f-8c9b-771ef7fe43ad tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1" status: 200 len: 1366 microversion: 2.1 time: 0.166371 Aug 03 19:22:43.247310 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 488/978] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:22:43 2022] GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:22:44.278028 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-97e48a84-cf19-495b-98c0-7b6a0220745c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:22:44.278741 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-97e48a84-cf19-495b-98c0-7b6a0220745c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 160754d3-09be-409f-acb5-7f7acc57bfc1] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:22:44.285994 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-97e48a84-cf19-495b-98c0-7b6a0220745c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:44.286438 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-97e48a84-cf19-495b-98c0-7b6a0220745c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:44.287258 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-97e48a84-cf19-495b-98c0-7b6a0220745c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:44.287691 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-97e48a84-cf19-495b-98c0-7b6a0220745c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:44.428515 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-97e48a84-cf19-495b-98c0-7b6a0220745c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:22:44.436235 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-97e48a84-cf19-495b-98c0-7b6a0220745c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1" status: 200 len: 1366 microversion: 2.1 time: 0.162556 Aug 03 19:22:44.436809 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 491/979] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:22:44 2022] GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:22:45.457148 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-b93938b1-bf98-469c-8c72-2433dcafe3ed tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:22:45.457755 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-b93938b1-bf98-469c-8c72-2433dcafe3ed tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 160754d3-09be-409f-acb5-7f7acc57bfc1] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:22:45.463909 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b93938b1-bf98-469c-8c72-2433dcafe3ed tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:45.464368 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b93938b1-bf98-469c-8c72-2433dcafe3ed tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:45.465137 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b93938b1-bf98-469c-8c72-2433dcafe3ed tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:45.465581 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b93938b1-bf98-469c-8c72-2433dcafe3ed tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:45.600566 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-b93938b1-bf98-469c-8c72-2433dcafe3ed tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:22:45.609277 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-b93938b1-bf98-469c-8c72-2433dcafe3ed tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1" status: 200 len: 1366 microversion: 2.1 time: 0.156184 Aug 03 19:22:45.609852 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 489/980] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:22:45 2022] GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:22:46.630039 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-8a9ac400-b69b-44cb-aaeb-917338820d09 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:22:46.630658 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-8a9ac400-b69b-44cb-aaeb-917338820d09 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 160754d3-09be-409f-acb5-7f7acc57bfc1] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:22:46.637307 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8a9ac400-b69b-44cb-aaeb-917338820d09 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:46.637763 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8a9ac400-b69b-44cb-aaeb-917338820d09 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:46.639361 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8a9ac400-b69b-44cb-aaeb-917338820d09 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:46.639813 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8a9ac400-b69b-44cb-aaeb-917338820d09 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:46.781985 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-8a9ac400-b69b-44cb-aaeb-917338820d09 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:22:46.789894 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-8a9ac400-b69b-44cb-aaeb-917338820d09 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1" status: 200 len: 1366 microversion: 2.1 time: 0.163634 Aug 03 19:22:46.790777 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 492/981] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:22:46 2022] GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:22:47.038293 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-255af4c3-2857-409e-b7b1-2d66e7495d04 req-23bda0a7-4c11-492b-b621-967b7ffb0eba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "160754d3-09be-409f-acb5-7f7acc57bfc1", "name": "network-vif-plugged", "status": "completed", "tag": "5971c936-075c-46e2-bc75-d601969557dd"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:22:47.049029 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-255af4c3-2857-409e-b7b1-2d66e7495d04 req-23bda0a7-4c11-492b-b621-967b7ffb0eba service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:47.049479 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-255af4c3-2857-409e-b7b1-2d66e7495d04 req-23bda0a7-4c11-492b-b621-967b7ffb0eba service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:47.062569 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-255af4c3-2857-409e-b7b1-2d66e7495d04 req-23bda0a7-4c11-492b-b621-967b7ffb0eba service nova] Creating event network-vif-plugged:5971c936-075c-46e2-bc75-d601969557dd for instance 160754d3-09be-409f-acb5-7f7acc57bfc1 on hv-cinder-85202 Aug 03 19:22:47.067826 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-255af4c3-2857-409e-b7b1-2d66e7495d04 req-23bda0a7-4c11-492b-b621-967b7ffb0eba service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094953 Aug 03 19:22:47.068652 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 490/982] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:22:47.811052 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-7561df99-32b1-45c5-9983-fbffefe96de0 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:22:47.811811 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-7561df99-32b1-45c5-9983-fbffefe96de0 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 160754d3-09be-409f-acb5-7f7acc57bfc1] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:22:47.818346 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-7561df99-32b1-45c5-9983-fbffefe96de0 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:47.818791 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-7561df99-32b1-45c5-9983-fbffefe96de0 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:47.819775 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-7561df99-32b1-45c5-9983-fbffefe96de0 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:47.820027 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-7561df99-32b1-45c5-9983-fbffefe96de0 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:47.952788 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-7561df99-32b1-45c5-9983-fbffefe96de0 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:22:47.960177 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-7561df99-32b1-45c5-9983-fbffefe96de0 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1" status: 200 len: 1366 microversion: 2.1 time: 0.153411 Aug 03 19:22:47.960760 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 493/983] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:22:47 2022] GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:22:49.033376 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell0:SELECT=2 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:22:49.034145 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell0:SELECT=6 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:22:49.038286 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-b24359df-1bf7-4bdf-ab25-3a6a3c21c5d8 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:22:49.039007 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-b24359df-1bf7-4bdf-ab25-3a6a3c21c5d8 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 160754d3-09be-409f-acb5-7f7acc57bfc1] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:22:49.045985 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b24359df-1bf7-4bdf-ab25-3a6a3c21c5d8 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:49.047056 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b24359df-1bf7-4bdf-ab25-3a6a3c21c5d8 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:49.047237 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b24359df-1bf7-4bdf-ab25-3a6a3c21c5d8 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:49.047664 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b24359df-1bf7-4bdf-ab25-3a6a3c21c5d8 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:49.182968 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-b24359df-1bf7-4bdf-ab25-3a6a3c21c5d8 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:22:49.191070 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-b24359df-1bf7-4bdf-ab25-3a6a3c21c5d8 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1" status: 200 len: 1366 microversion: 2.1 time: 0.159105 Aug 03 19:22:49.197436 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 491/984] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:22:49 2022] GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:22:50.213082 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-eb63a419-e6cc-4ce3-ad48-db247a76282f tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:22:50.213658 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-eb63a419-e6cc-4ce3-ad48-db247a76282f tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 160754d3-09be-409f-acb5-7f7acc57bfc1] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:22:50.215563 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell0:SELECT=6 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:22:50.222091 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-eb63a419-e6cc-4ce3-ad48-db247a76282f tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:50.222533 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-eb63a419-e6cc-4ce3-ad48-db247a76282f tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:50.223326 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-eb63a419-e6cc-4ce3-ad48-db247a76282f tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:50.223754 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-eb63a419-e6cc-4ce3-ad48-db247a76282f tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:50.227724 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:22:50.360476 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-eb63a419-e6cc-4ce3-ad48-db247a76282f tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:22:50.367887 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-eb63a419-e6cc-4ce3-ad48-db247a76282f tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1" status: 200 len: 1555 microversion: 2.1 time: 0.158745 Aug 03 19:22:50.368522 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 494/985] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:22:50 2022] GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1 => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:22:50.389139 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-a6946f02-c9c5-49f9-aeb9-6e11becdccc4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:22:50.389684 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-a6946f02-c9c5-49f9-aeb9-6e11becdccc4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 160754d3-09be-409f-acb5-7f7acc57bfc1] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:22:50.396426 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a6946f02-c9c5-49f9-aeb9-6e11becdccc4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:50.396873 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a6946f02-c9c5-49f9-aeb9-6e11becdccc4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:50.397642 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a6946f02-c9c5-49f9-aeb9-6e11becdccc4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:50.398081 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a6946f02-c9c5-49f9-aeb9-6e11becdccc4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:50.476602 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-a6946f02-c9c5-49f9-aeb9-6e11becdccc4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091871 Aug 03 19:22:50.477199 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 492/986] 10.222.0.77 () {58 vars in 1275 bytes} [Wed Aug 3 19:22:50 2022] GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:22:51.556938 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [req-888d06cb-e1ed-46ea-ad38-28a4ce537887 req-e817959b-441b-455b-859d-895b758e4b4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "160754d3-09be-409f-acb5-7f7acc57bfc1", "tag": "5971c936-075c-46e2-bc75-d601969557dd"}]} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:22:51.564144 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:22:51.570061 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-888d06cb-e1ed-46ea-ad38-28a4ce537887 req-e817959b-441b-455b-859d-895b758e4b4d service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:22:51.570511 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-888d06cb-e1ed-46ea-ad38-28a4ce537887 req-e817959b-441b-455b-859d-895b758e4b4d service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:22:51.582919 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.compute.server_external_events [req-888d06cb-e1ed-46ea-ad38-28a4ce537887 req-e817959b-441b-455b-859d-895b758e4b4d service nova] Creating event network-changed:5971c936-075c-46e2-bc75-d601969557dd for instance 160754d3-09be-409f-acb5-7f7acc57bfc1 on hv-cinder-85202 Aug 03 19:22:51.588346 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [req-888d06cb-e1ed-46ea-ad38-28a4ce537887 req-e817959b-441b-455b-859d-895b758e4b4d service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111144 Aug 03 19:22:51.589288 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 495/987] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:24:06.901598 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:24:06.902363 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=96 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:24:06.987301 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-cddf512c-d3d0-4c0c-b165-3856745f9356 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:24:06.987924 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-cddf512c-d3d0-4c0c-b165-3856745f9356 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 160754d3-09be-409f-acb5-7f7acc57bfc1] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:24:06.993934 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-cddf512c-d3d0-4c0c-b165-3856745f9356 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:06.994379 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-cddf512c-d3d0-4c0c-b165-3856745f9356 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:06.995165 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-cddf512c-d3d0-4c0c-b165-3856745f9356 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:06.995604 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-cddf512c-d3d0-4c0c-b165-3856745f9356 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:07.020132 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-cddf512c-d3d0-4c0c-b165-3856745f9356 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1/ips" status: 200 len: 149 microversion: 2.1 time: 0.120354 Aug 03 19:24:07.020679 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 493/988] 10.222.0.77 () {58 vars in 1248 bytes} [Wed Aug 3 19:24:06 2022] GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1/ips => generated 149 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:24:09.709258 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=6 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:24:09.713919 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-7ce6f950-010d-463c-af1b-aec8769863e6 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc20efd8-4b43-4508-b496-0dc2ec268179"}} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:24:09.717076 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-7ce6f950-010d-463c-af1b-aec8769863e6 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 160754d3-09be-409f-acb5-7f7acc57bfc1] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:24:09.724059 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-7ce6f950-010d-463c-af1b-aec8769863e6 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:09.731536 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-7ce6f950-010d-463c-af1b-aec8769863e6 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:09.731536 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-7ce6f950-010d-463c-af1b-aec8769863e6 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:09.731536 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-7ce6f950-010d-463c-af1b-aec8769863e6 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:10.643378 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-7ce6f950-010d-463c-af1b-aec8769863e6 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "POST /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.936135 Aug 03 19:24:10.644132 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 496/989] 10.222.0.77 () {60 vars in 1323 bytes} [Wed Aug 3 19:24:09 2022] POST /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1/os-volume_attachments => generated 194 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:24:19.226114 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-e3a26291-995f-4521-8553-0b4145db395a tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc20efd8-4b43-4508-b496-0dc2ec268179"}} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:24:19.228560 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-e3a26291-995f-4521-8553-0b4145db395a tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 160754d3-09be-409f-acb5-7f7acc57bfc1] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:24:19.230692 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=4 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:24:19.231408 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_api:SELECT=2 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:24:19.236228 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e3a26291-995f-4521-8553-0b4145db395a tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:19.236674 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e3a26291-995f-4521-8553-0b4145db395a tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:19.237443 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e3a26291-995f-4521-8553-0b4145db395a tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:19.237875 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-e3a26291-995f-4521-8553-0b4145db395a tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:19.369651 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.wsgi [None req-e3a26291-995f-4521-8553-0b4145db395a tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] HTTP exception thrown: Invalid volume: volume cc20efd8-4b43-4508-b496-0dc2ec268179 is already attached to instances: 160754d3-09be-409f-acb5-7f7acc57bfc1 Aug 03 19:24:19.371457 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-e3a26291-995f-4521-8553-0b4145db395a tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Request method failure captured: Aug 03 19:24:19.371457 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: request: POST /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1/os-volume_attachments HTTP/1.1 Aug 03 19:24:19.371457 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept: application/json Aug 03 19:24:19.371457 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept-Encoding: identity Aug 03 19:24:19.371457 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Connection: close Aug 03 19:24:19.371457 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Length: 74 Aug 03 19:24:19.371457 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Type: application/json Aug 03 19:24:19.371457 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Host: 10.222.0.77 Aug 03 19:24:19.371457 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Openstack-System-Scope: None Aug 03 19:24:19.371457 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: User-Agent: python-urllib3/1.26.11 Aug 03 19:24:19.371457 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Auth-Token: gAAAAABi6soo3tVsyMpp4Q5BeVYgBkb-ZmSXfFqqDLxngfO69yiJ0ybu4b_gQBD6U7zMaZpKagPnF0tkOMv2DMg2Ki8vJ6bAkRfUIOgz6V1xoe8gX_F1YIssVOFX-QTa-WpQkCCkJJtYSX1EJo1Xmv5e_ntC-Qe1WtL2fOzOa0FpdkQ5uZgdkSk Aug 03 19:24:19.371457 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Id: None Aug 03 19:24:19.371457 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Name: None Aug 03 19:24:19.371457 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Identity-Status: Confirmed Aug 03 19:24:19.371457 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Is-Admin-Project: True Aug 03 19:24:19.371457 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Id: default Aug 03 19:24:19.371457 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Name: Default Aug 03 19:24:19.371457 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Id: e02e6595d2284de190bb759806ca02f6 Aug 03 19:24:19.371457 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Name: tempest-AttachVolumeNegativeTest-1363049785 Aug 03 19:24:19.371457 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Role: reader,member Aug 03 19:24:19.371457 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Roles: reader,member Aug 03 19:24:19.373225 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_e02e6595d2284de190bb759806ca02f6", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/e02e6595d2284de190bb759806ca02f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/e02e6595d2284de190bb759806ca02f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/e02e6595d2284de190bb759806ca02f6"}]}] Aug 03 19:24:19.373225 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant: tempest-AttachVolumeNegativeTest-1363049785 Aug 03 19:24:19.373225 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Id: e02e6595d2284de190bb759806ca02f6 Aug 03 19:24:19.373225 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1363049785 Aug 03 19:24:19.373225 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User: tempest-AttachVolumeNegativeTest-1363049785-project Aug 03 19:24:19.373225 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Id: default Aug 03 19:24:19.373225 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Name: Default Aug 03 19:24:19.373225 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Id: 32425eddf65f477db53594f7d4b447e2 Aug 03 19:24:19.373225 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Name: tempest-AttachVolumeNegativeTest-1363049785-project Aug 03 19:24:19.373225 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Aug 03 19:24:19.373225 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: {"volumeAttachment": {"volumeId": "cc20efd8-4b43-4508-b496-0dc2ec268179"}} Aug 03 19:24:19.373225 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: method: > Aug 03 19:24:19.374081 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: exception: Invalid volume: volume cc20efd8-4b43-4508-b496-0dc2ec268179 is already attached to instances: 160754d3-09be-409f-acb5-7f7acc57bfc1 Aug 03 19:24:19.374081 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: action_args: {'server_id': '160754d3-09be-409f-acb5-7f7acc57bfc1', 'body': {'volumeAttachment': {'volumeId': 'cc20efd8-4b43-4508-b496-0dc2ec268179'}}} Aug 03 19:24:19.374081 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:24:19.374081 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:24:19.374081 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 03 19:24:19.374081 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 03 19:24:19.374081 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 19:24:19.374081 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 19:24:19.374081 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 03 19:24:19.374081 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 19:24:19.374081 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 03 19:24:19.374081 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 03 19:24:19.374081 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 03 19:24:19.374081 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 03 19:24:19.374081 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume cc20efd8-4b43-4508-b496-0dc2ec268179 is already attached to instances: 160754d3-09be-409f-acb5-7f7acc57bfc1 Aug 03 19:24:19.374081 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:24:19.374081 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:24:19.374081 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:24:19.374081 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:24:19.376193 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:24:19.376193 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:24:19.376193 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:24:19.376193 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:24:19.376193 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:24:19.376193 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:24:19.376193 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 19:24:19.376193 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 19:24:19.376193 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 19:24:19.376193 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 19:24:19.376193 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 19:24:19.376193 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 19:24:19.376193 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 03 19:24:19.376193 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 03 19:24:19.376193 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume cc20efd8-4b43-4508-b496-0dc2ec268179 is already attached to instances: 160754d3-09be-409f-acb5-7f7acc57bfc1 Aug 03 19:24:19.376193 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:24:19.376193 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:24:19.376193 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:24:19.376193 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:24:19.376193 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:24:19.377519 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:24:19.377519 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:24:19.377519 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:24:19.377519 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume cc20efd8-4b43-4508-b496-0dc2ec268179 is already attached to instances: 160754d3-09be-409f-acb5-7f7acc57bfc1 Aug 03 19:24:19.377519 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:24:19.377519 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-e3a26291-995f-4521-8553-0b4145db395a tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Returning 400 to user: Invalid volume: volume cc20efd8-4b43-4508-b496-0dc2ec268179 is already attached to instances: 160754d3-09be-409f-acb5-7f7acc57bfc1 {{(pid=118302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:24:19.377519 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-e3a26291-995f-4521-8553-0b4145db395a tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "POST /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.150916 Aug 03 19:24:19.377519 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 494/990] 10.222.0.77 () {60 vars in 1323 bytes} [Wed Aug 3 19:24:19 2022] POST /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1/os-volume_attachments => generated 174 bytes in 152 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 19:24:19.443348 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-4eb0f4ed-45b4-4394-96d6-e8656a5e3f24 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:24:19.443933 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-4eb0f4ed-45b4-4394-96d6-e8656a5e3f24 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 160754d3-09be-409f-acb5-7f7acc57bfc1] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:24:19.450097 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4eb0f4ed-45b4-4394-96d6-e8656a5e3f24 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:19.450536 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4eb0f4ed-45b4-4394-96d6-e8656a5e3f24 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:19.451323 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4eb0f4ed-45b4-4394-96d6-e8656a5e3f24 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:19.451747 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4eb0f4ed-45b4-4394-96d6-e8656a5e3f24 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:19.534450 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.objects.instance [None req-4eb0f4ed-45b4-4394-96d6-e8656a5e3f24 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lazy-loading 'services' on Instance uuid 160754d3-09be-409f-acb5-7f7acc57bfc1 {{(pid=118303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:24:19.684194 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-4eb0f4ed-45b4-4394-96d6-e8656a5e3f24 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "DELETE /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1/os-volume_attachments/cc20efd8-4b43-4508-b496-0dc2ec268179" status: 202 len: 0 microversion: 2.1 time: 0.249568 Aug 03 19:24:19.684855 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 497/991] 10.222.0.77 () {58 vars in 1416 bytes} [Wed Aug 3 19:24:19 2022] DELETE /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1/os-volume_attachments/cc20efd8-4b43-4508-b496-0dc2ec268179 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 19:24:19.694653 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-3a1629f0-8ba8-48fa-8461-7fd5e5dc2c0b tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:24:19.697736 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-3a1629f0-8ba8-48fa-8461-7fd5e5dc2c0b tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 160754d3-09be-409f-acb5-7f7acc57bfc1] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:24:19.703076 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3a1629f0-8ba8-48fa-8461-7fd5e5dc2c0b tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:19.703667 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3a1629f0-8ba8-48fa-8461-7fd5e5dc2c0b tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:19.704464 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3a1629f0-8ba8-48fa-8461-7fd5e5dc2c0b tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:19.704926 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3a1629f0-8ba8-48fa-8461-7fd5e5dc2c0b tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:19.740904 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-3a1629f0-8ba8-48fa-8461-7fd5e5dc2c0b tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050453 Aug 03 19:24:19.741461 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 495/992] 10.222.0.77 () {58 vars in 1302 bytes} [Wed Aug 3 19:24:19 2022] GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:24:20.755523 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-655aee21-0e74-4a99-9cad-7a6e6bf36b3b tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:24:20.757820 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-655aee21-0e74-4a99-9cad-7a6e6bf36b3b tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 160754d3-09be-409f-acb5-7f7acc57bfc1] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:24:20.764087 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-655aee21-0e74-4a99-9cad-7a6e6bf36b3b tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:20.764529 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-655aee21-0e74-4a99-9cad-7a6e6bf36b3b tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:20.765285 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-655aee21-0e74-4a99-9cad-7a6e6bf36b3b tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:20.765711 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-655aee21-0e74-4a99-9cad-7a6e6bf36b3b tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:20.796196 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-655aee21-0e74-4a99-9cad-7a6e6bf36b3b tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046575 Aug 03 19:24:20.796751 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 498/993] 10.222.0.77 () {58 vars in 1302 bytes} [Wed Aug 3 19:24:20 2022] GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 19:24:20.858720 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-df029b87-aa7b-4f8c-a7db-c6f0906e6389 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:24:20.859290 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-df029b87-aa7b-4f8c-a7db-c6f0906e6389 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 160754d3-09be-409f-acb5-7f7acc57bfc1] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:24:20.866694 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-df029b87-aa7b-4f8c-a7db-c6f0906e6389 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:20.867181 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-df029b87-aa7b-4f8c-a7db-c6f0906e6389 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:20.867940 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-df029b87-aa7b-4f8c-a7db-c6f0906e6389 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:20.868370 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-df029b87-aa7b-4f8c-a7db-c6f0906e6389 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:20.895909 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-df029b87-aa7b-4f8c-a7db-c6f0906e6389 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 160754d3-09be-409f-acb5-7f7acc57bfc1] Going to try to terminate instance {{(pid=118302) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 19:24:21.160124 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-df029b87-aa7b-4f8c-a7db-c6f0906e6389 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "DELETE /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1" status: 204 len: 0 microversion: 2.1 time: 0.304940 Aug 03 19:24:21.160709 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 496/994] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 3 19:24:20 2022] DELETE /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 19:24:21.168784 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-16b14a00-6521-4453-ae2c-ec7c41a1cd23 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:24:21.171972 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-16b14a00-6521-4453-ae2c-ec7c41a1cd23 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 160754d3-09be-409f-acb5-7f7acc57bfc1] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:24:21.175657 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-16b14a00-6521-4453-ae2c-ec7c41a1cd23 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:21.176109 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-16b14a00-6521-4453-ae2c-ec7c41a1cd23 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:21.176866 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-16b14a00-6521-4453-ae2c-ec7c41a1cd23 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:21.177309 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-16b14a00-6521-4453-ae2c-ec7c41a1cd23 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:21.310572 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-16b14a00-6521-4453-ae2c-ec7c41a1cd23 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:24:21.318982 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-16b14a00-6521-4453-ae2c-ec7c41a1cd23 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1" status: 200 len: 1680 microversion: 2.1 time: 0.153997 Aug 03 19:24:21.319533 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 499/995] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:24:21 2022] GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:24:22.340680 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-08b8634a-356d-499e-9012-5eee3b664cc7 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:24:22.341314 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-08b8634a-356d-499e-9012-5eee3b664cc7 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 160754d3-09be-409f-acb5-7f7acc57bfc1] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:24:22.348367 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-08b8634a-356d-499e-9012-5eee3b664cc7 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:22.348827 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-08b8634a-356d-499e-9012-5eee3b664cc7 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:22.349595 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-08b8634a-356d-499e-9012-5eee3b664cc7 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:22.350056 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-08b8634a-356d-499e-9012-5eee3b664cc7 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:22.484625 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-08b8634a-356d-499e-9012-5eee3b664cc7 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:24:22.492800 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-08b8634a-356d-499e-9012-5eee3b664cc7 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1" status: 200 len: 1680 microversion: 2.1 time: 0.156526 Aug 03 19:24:22.493365 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 497/996] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:24:22 2022] GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:24:23.513169 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-e8eb679c-1bd7-47fb-9e72-c5003653822e tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:24:23.513923 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-e8eb679c-1bd7-47fb-9e72-c5003653822e tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 160754d3-09be-409f-acb5-7f7acc57bfc1] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:24:23.520921 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e8eb679c-1bd7-47fb-9e72-c5003653822e tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:23.521532 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e8eb679c-1bd7-47fb-9e72-c5003653822e tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:23.522490 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e8eb679c-1bd7-47fb-9e72-c5003653822e tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:23.522933 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e8eb679c-1bd7-47fb-9e72-c5003653822e tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:23.662164 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-e8eb679c-1bd7-47fb-9e72-c5003653822e tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:24:23.669895 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-e8eb679c-1bd7-47fb-9e72-c5003653822e tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1" status: 200 len: 1680 microversion: 2.1 time: 0.160568 Aug 03 19:24:23.670500 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 500/997] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:24:23 2022] GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:24:23.979568 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-c300f4bd-fdf2-456b-82f8-8adad72743de req-ede142a7-6a42-44ec-862a-6d4dcaa6de61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "160754d3-09be-409f-acb5-7f7acc57bfc1", "name": "network-vif-deleted", "tag": "5971c936-075c-46e2-bc75-d601969557dd"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:24:23.989794 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-c300f4bd-fdf2-456b-82f8-8adad72743de req-ede142a7-6a42-44ec-862a-6d4dcaa6de61 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:23.990285 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-c300f4bd-fdf2-456b-82f8-8adad72743de req-ede142a7-6a42-44ec-862a-6d4dcaa6de61 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:24.004058 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-c300f4bd-fdf2-456b-82f8-8adad72743de req-ede142a7-6a42-44ec-862a-6d4dcaa6de61 service nova] Creating event network-vif-deleted:5971c936-075c-46e2-bc75-d601969557dd for instance 160754d3-09be-409f-acb5-7f7acc57bfc1 on hv-cinder-85202 Aug 03 19:24:24.009761 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-c300f4bd-fdf2-456b-82f8-8adad72743de req-ede142a7-6a42-44ec-862a-6d4dcaa6de61 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086425 Aug 03 19:24:24.011333 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 498/998] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:24:24.692244 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-544377d1-4178-4ae4-a7d4-2d9eca20430a tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:24:24.693068 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-544377d1-4178-4ae4-a7d4-2d9eca20430a tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 160754d3-09be-409f-acb5-7f7acc57bfc1] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:24:24.700016 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-544377d1-4178-4ae4-a7d4-2d9eca20430a tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:24.700563 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-544377d1-4178-4ae4-a7d4-2d9eca20430a tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:24.701421 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-544377d1-4178-4ae4-a7d4-2d9eca20430a tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:24.701918 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-544377d1-4178-4ae4-a7d4-2d9eca20430a tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:24.888381 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-544377d1-4178-4ae4-a7d4-2d9eca20430a tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:24.888888 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-544377d1-4178-4ae4-a7d4-2d9eca20430a tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:24.889349 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.objects.instance [None req-544377d1-4178-4ae4-a7d4-2d9eca20430a tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lazy-loading 'fault' on Instance uuid 160754d3-09be-409f-acb5-7f7acc57bfc1 {{(pid=118303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:24:24.931883 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-544377d1-4178-4ae4-a7d4-2d9eca20430a tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:24:24.940429 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-544377d1-4178-4ae4-a7d4-2d9eca20430a tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1" status: 200 len: 1331 microversion: 2.1 time: 0.251715 Aug 03 19:24:24.940986 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 501/999] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:24:24 2022] GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1 => generated 1331 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:24:25.962936 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-8feeb110-db26-47a7-a5f6-9d3caf06a6ed tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:24:25.963660 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-8feeb110-db26-47a7-a5f6-9d3caf06a6ed tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 160754d3-09be-409f-acb5-7f7acc57bfc1] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:24:25.970391 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8feeb110-db26-47a7-a5f6-9d3caf06a6ed tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:25.970843 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8feeb110-db26-47a7-a5f6-9d3caf06a6ed tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:25.971792 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8feeb110-db26-47a7-a5f6-9d3caf06a6ed tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:25.972231 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8feeb110-db26-47a7-a5f6-9d3caf06a6ed tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:25.985278 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.wsgi [None req-8feeb110-db26-47a7-a5f6-9d3caf06a6ed tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] HTTP exception thrown: Instance 160754d3-09be-409f-acb5-7f7acc57bfc1 could not be found. Aug 03 19:24:25.987242 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-8feeb110-db26-47a7-a5f6-9d3caf06a6ed tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Request method failure captured: Aug 03 19:24:25.987242 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: request: GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1 HTTP/1.1 Aug 03 19:24:25.987242 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept: application/json Aug 03 19:24:25.987242 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept-Encoding: identity Aug 03 19:24:25.987242 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Connection: close Aug 03 19:24:25.987242 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Length: 0 Aug 03 19:24:25.987242 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Type: application/json Aug 03 19:24:25.987242 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Host: 10.222.0.77 Aug 03 19:24:25.987242 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Openstack-System-Scope: None Aug 03 19:24:25.987242 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: User-Agent: python-urllib3/1.26.11 Aug 03 19:24:25.987242 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Auth-Token: gAAAAABi6soo3tVsyMpp4Q5BeVYgBkb-ZmSXfFqqDLxngfO69yiJ0ybu4b_gQBD6U7zMaZpKagPnF0tkOMv2DMg2Ki8vJ6bAkRfUIOgz6V1xoe8gX_F1YIssVOFX-QTa-WpQkCCkJJtYSX1EJo1Xmv5e_ntC-Qe1WtL2fOzOa0FpdkQ5uZgdkSk Aug 03 19:24:25.987242 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Id: None Aug 03 19:24:25.987242 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Name: None Aug 03 19:24:25.987242 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Identity-Status: Confirmed Aug 03 19:24:25.987242 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Is-Admin-Project: True Aug 03 19:24:25.987242 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Id: default Aug 03 19:24:25.987242 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Name: Default Aug 03 19:24:25.987242 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Id: e02e6595d2284de190bb759806ca02f6 Aug 03 19:24:25.987242 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Name: tempest-AttachVolumeNegativeTest-1363049785 Aug 03 19:24:25.987242 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Role: reader,member Aug 03 19:24:25.987242 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Roles: reader,member Aug 03 19:24:25.988950 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_e02e6595d2284de190bb759806ca02f6", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/e02e6595d2284de190bb759806ca02f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/e02e6595d2284de190bb759806ca02f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/e02e6595d2284de190bb759806ca02f6"}]}] Aug 03 19:24:25.988950 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant: tempest-AttachVolumeNegativeTest-1363049785 Aug 03 19:24:25.988950 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Id: e02e6595d2284de190bb759806ca02f6 Aug 03 19:24:25.988950 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1363049785 Aug 03 19:24:25.988950 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User: tempest-AttachVolumeNegativeTest-1363049785-project Aug 03 19:24:25.988950 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Id: default Aug 03 19:24:25.988950 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Name: Default Aug 03 19:24:25.988950 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Id: 32425eddf65f477db53594f7d4b447e2 Aug 03 19:24:25.988950 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Name: tempest-AttachVolumeNegativeTest-1363049785-project Aug 03 19:24:25.988950 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: method: > Aug 03 19:24:25.988950 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: exception: Instance 160754d3-09be-409f-acb5-7f7acc57bfc1 could not be found. Aug 03 19:24:25.988950 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: action_args: {'id': '160754d3-09be-409f-acb5-7f7acc57bfc1'} Aug 03 19:24:25.990026 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:24:25.990026 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:24:25.990026 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:24:25.990026 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:24:25.990026 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:24:25.990026 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:24:25.990026 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:24:25.990026 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:24:25.990026 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:24:25.990026 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:24:25.990026 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 160754d3-09be-409f-acb5-7f7acc57bfc1 could not be found. Aug 03 19:24:25.990026 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:24:25.990026 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:24:25.990026 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:24:25.990026 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:24:25.990026 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:24:25.990026 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:24:25.990026 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:24:25.990026 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:24:25.990026 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:24:25.991649 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:24:25.991649 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:24:25.991649 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:24:25.991649 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:24:25.991649 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:24:25.991649 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:24:25.991649 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:24:25.991649 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 160754d3-09be-409f-acb5-7f7acc57bfc1 could not be found. Aug 03 19:24:25.991649 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:24:25.991649 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:24:25.991649 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:24:25.991649 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:24:25.991649 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:24:25.991649 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:24:25.991649 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:24:25.991649 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:24:25.991649 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 160754d3-09be-409f-acb5-7f7acc57bfc1 could not be found. Aug 03 19:24:25.991649 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:24:25.993160 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-8feeb110-db26-47a7-a5f6-9d3caf06a6ed tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Returning 404 to user: Instance 160754d3-09be-409f-acb5-7f7acc57bfc1 could not be found. {{(pid=118302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:24:25.993160 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-8feeb110-db26-47a7-a5f6-9d3caf06a6ed tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1" status: 404 len: 111 microversion: 2.1 time: 0.029977 Aug 03 19:24:25.993160 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 499/1000] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:24:25 2022] GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:24:25.997565 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-8e7f72ea-96cf-411d-ae53-f06b2b1073ec tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '.version_select at 0x7f4786115c10>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:24:26.085881 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-8e7f72ea-96cf-411d-ae53-f06b2b1073ec tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1314866662" status: 202 len: 0 microversion: 2.1 time: 0.092063 Aug 03 19:24:26.086446 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 502/1001] 10.222.0.77 () {58 vars in 1221 bytes} [Wed Aug 3 19:24:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1314866662 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 19:24:26.852899 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-dad8a4cd-70c6-4949-83a7-e9d2f4d49b87 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Action: 'create', calling method: .version_select at 0x7f478627f430>, body: {"keypair": {"name": "tempest-keypair-744757441", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKX1oHIu6YysVAdTWqUwj5PVtUt3iUK6+Ex90ubQu1mS3yq+cWgi+Zt4ZZtnffxqCHVJ74GileSCOapYYQ4R63+tN8WrDwhW4raUy3Pq62/kDQ9BR1kZkXi9LTpXEit/Nw=="}} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:24:26.868297 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.quota [None req-dad8a4cd-70c6-4949-83a7-e9d2f4d49b87 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Getting quotas for project e02e6595d2284de190bb759806ca02f6. Resources: {'key_pairs'} {{(pid=118302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:24:26.872078 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.quota [None req-dad8a4cd-70c6-4949-83a7-e9d2f4d49b87 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Getting quotas for user 32425eddf65f477db53594f7d4b447e2 and project e02e6595d2284de190bb759806ca02f6. Resources: {'key_pairs'} {{(pid=118302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:24:26.926065 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-dad8a4cd-70c6-4949-83a7-e9d2f4d49b87 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.076991 Aug 03 19:24:26.926647 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 500/1002] 10.222.0.77 () {60 vars in 1159 bytes} [Wed Aug 3 19:24:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:24:29.409889 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-f8153d4a-b8f6-455b-b9b6-119d26833bb1 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1378672028", "imageRef": "0b6be242-215e-4886-a0d2-b8d5f8ca623e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b27e972d-f40b-4fda-b5a4-b93304ec49ce"}], "security_groups": [{"name": "tempest-securitygroup--1338814862"}], "key_name": "tempest-keypair-744757441", "user_data": "}} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:24:29.513248 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.network.neutron [None req-f8153d4a-b8f6-455b-b9b6-119d26833bb1 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] validate_networks() for [('b27e972d-f40b-4fda-b5a4-b93304ec49ce', None, None, None, None, None)] {{(pid=118303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 19:24:29.943825 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-f8153d4a-b8f6-455b-b9b6-119d26833bb1 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Flavor limits 0:0:0 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 19:24:29.944265 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-f8153d4a-b8f6-455b-b9b6-119d26833bb1 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Image limits 0:0:0 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 19:24:29.944745 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-f8153d4a-b8f6-455b-b9b6-119d26833bb1 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Flavor pref 0:0:0 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 19:24:29.945149 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-f8153d4a-b8f6-455b-b9b6-119d26833bb1 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Image pref 0:0:0 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 19:24:29.945555 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-f8153d4a-b8f6-455b-b9b6-119d26833bb1 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 19:24:29.954339 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f8153d4a-b8f6-455b-b9b6-119d26833bb1 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:29.954784 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f8153d4a-b8f6-455b-b9b6-119d26833bb1 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:29.956712 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f8153d4a-b8f6-455b-b9b6-119d26833bb1 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:29.957304 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f8153d4a-b8f6-455b-b9b6-119d26833bb1 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:29.974268 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.quota [None req-f8153d4a-b8f6-455b-b9b6-119d26833bb1 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Getting quotas for project e02e6595d2284de190bb759806ca02f6. Resources: {'instances', 'cores', 'ram'} {{(pid=118303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:24:29.978232 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.quota [None req-f8153d4a-b8f6-455b-b9b6-119d26833bb1 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Getting quotas for user 32425eddf65f477db53594f7d4b447e2 and project e02e6595d2284de190bb759806ca02f6. Resources: {'instances', 'cores', 'ram'} {{(pid=118303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:24:29.989613 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-f8153d4a-b8f6-455b-b9b6-119d26833bb1 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Going to run 1 instances... {{(pid=118303) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 19:24:29.991903 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-f8153d4a-b8f6-455b-b9b6-119d26833bb1 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: a825ddeb-ecda-4e57-94ed-84f48c6942d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0b6be242-215e-4886-a0d2-b8d5f8ca623e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 19:24:30.117760 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-f8153d4a-b8f6-455b-b9b6-119d26833bb1 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.712571 Aug 03 19:24:30.118310 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 503/1003] 10.222.0.77 () {60 vars in 1147 bytes} [Wed Aug 3 19:24:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 19:24:30.130583 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-f2920e04-db3f-4846-b4cd-84054a3ca534 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:24:30.131231 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-f2920e04-db3f-4846-b4cd-84054a3ca534 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: a825ddeb-ecda-4e57-94ed-84f48c6942d0] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:24:30.189358 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-f2920e04-db3f-4846-b4cd-84054a3ca534 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:24:30.197146 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-f2920e04-db3f-4846-b4cd-84054a3ca534 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0" status: 200 len: 1241 microversion: 2.1 time: 0.071877 Aug 03 19:24:30.209471 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 501/1004] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:24:30 2022] GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:24:31.218371 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-4efe0aca-7676-431d-9885-79b790997fd2 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:24:31.225766 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-4efe0aca-7676-431d-9885-79b790997fd2 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: a825ddeb-ecda-4e57-94ed-84f48c6942d0] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:24:31.225766 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4efe0aca-7676-431d-9885-79b790997fd2 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:31.225766 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4efe0aca-7676-431d-9885-79b790997fd2 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:31.226549 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4efe0aca-7676-431d-9885-79b790997fd2 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:31.227000 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4efe0aca-7676-431d-9885-79b790997fd2 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:31.293966 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-4efe0aca-7676-431d-9885-79b790997fd2 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:24:31.305888 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-4efe0aca-7676-431d-9885-79b790997fd2 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0" status: 200 len: 1237 microversion: 2.1 time: 0.087604 Aug 03 19:24:31.305888 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 504/1005] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:24:31 2022] GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0 => generated 1237 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:24:32.324190 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-8254e00c-7e87-462f-b43d-c2b68fa8c38f tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:24:32.324798 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-8254e00c-7e87-462f-b43d-c2b68fa8c38f tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: a825ddeb-ecda-4e57-94ed-84f48c6942d0] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:24:32.332740 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8254e00c-7e87-462f-b43d-c2b68fa8c38f tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:32.333189 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8254e00c-7e87-462f-b43d-c2b68fa8c38f tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:32.335763 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8254e00c-7e87-462f-b43d-c2b68fa8c38f tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:32.336662 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8254e00c-7e87-462f-b43d-c2b68fa8c38f tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:32.402773 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-8254e00c-7e87-462f-b43d-c2b68fa8c38f tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:24:32.411304 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-8254e00c-7e87-462f-b43d-c2b68fa8c38f tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0" status: 200 len: 1299 microversion: 2.1 time: 0.091121 Aug 03 19:24:32.411888 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 502/1006] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:24:32 2022] GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0 => generated 1299 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:24:33.432306 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-362d9ca5-6fae-40bf-be8b-f0cb617ae463 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:24:33.432991 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-362d9ca5-6fae-40bf-be8b-f0cb617ae463 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: a825ddeb-ecda-4e57-94ed-84f48c6942d0] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:24:33.439738 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-362d9ca5-6fae-40bf-be8b-f0cb617ae463 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:33.440196 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-362d9ca5-6fae-40bf-be8b-f0cb617ae463 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:33.441241 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-362d9ca5-6fae-40bf-be8b-f0cb617ae463 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:33.441440 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-362d9ca5-6fae-40bf-be8b-f0cb617ae463 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:33.572267 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-362d9ca5-6fae-40bf-be8b-f0cb617ae463 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:24:33.579833 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-362d9ca5-6fae-40bf-be8b-f0cb617ae463 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0" status: 200 len: 1367 microversion: 2.1 time: 0.151469 Aug 03 19:24:33.580436 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 505/1007] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:24:33 2022] GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:24:33.652257 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-33a2dd44-ed71-4f5a-ba15-37f84f21c670 req-fa3390d5-43a5-4e21-b268-81d176cb2062 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a825ddeb-ecda-4e57-94ed-84f48c6942d0", "tag": "56855336-a61c-45fa-beeb-54fd8e553b52"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:24:33.663066 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-33a2dd44-ed71-4f5a-ba15-37f84f21c670 req-fa3390d5-43a5-4e21-b268-81d176cb2062 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:33.663515 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-33a2dd44-ed71-4f5a-ba15-37f84f21c670 req-fa3390d5-43a5-4e21-b268-81d176cb2062 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:33.674886 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-33a2dd44-ed71-4f5a-ba15-37f84f21c670 req-fa3390d5-43a5-4e21-b268-81d176cb2062 service nova] Creating event network-changed:56855336-a61c-45fa-beeb-54fd8e553b52 for instance a825ddeb-ecda-4e57-94ed-84f48c6942d0 on hv-cinder-85202 Aug 03 19:24:33.680050 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-33a2dd44-ed71-4f5a-ba15-37f84f21c670 req-fa3390d5-43a5-4e21-b268-81d176cb2062 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031393 Aug 03 19:24:33.680707 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 503/1008] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:24:34.602258 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-f0375dc5-ba4a-4379-861e-209519c6a30e tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:24:34.602852 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-f0375dc5-ba4a-4379-861e-209519c6a30e tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: a825ddeb-ecda-4e57-94ed-84f48c6942d0] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:24:34.609518 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f0375dc5-ba4a-4379-861e-209519c6a30e tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:34.609974 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f0375dc5-ba4a-4379-861e-209519c6a30e tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:34.610780 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f0375dc5-ba4a-4379-861e-209519c6a30e tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:34.611399 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f0375dc5-ba4a-4379-861e-209519c6a30e tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:34.745743 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-f0375dc5-ba4a-4379-861e-209519c6a30e tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:24:34.753199 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-f0375dc5-ba4a-4379-861e-209519c6a30e tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0" status: 200 len: 1367 microversion: 2.1 time: 0.154832 Aug 03 19:24:34.753820 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 506/1009] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:24:34 2022] GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:24:35.775477 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-c0300f20-855c-489c-8084-488676910ae3 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:24:35.776175 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-c0300f20-855c-489c-8084-488676910ae3 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: a825ddeb-ecda-4e57-94ed-84f48c6942d0] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:24:35.782790 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c0300f20-855c-489c-8084-488676910ae3 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:35.783699 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c0300f20-855c-489c-8084-488676910ae3 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:35.785107 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c0300f20-855c-489c-8084-488676910ae3 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:35.785545 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c0300f20-855c-489c-8084-488676910ae3 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:35.926255 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-c0300f20-855c-489c-8084-488676910ae3 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:24:35.933920 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-c0300f20-855c-489c-8084-488676910ae3 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0" status: 200 len: 1367 microversion: 2.1 time: 0.163540 Aug 03 19:24:35.934486 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 504/1010] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:24:35 2022] GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:24:36.955246 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-94dd3260-2d60-4e8b-af74-bb00931b0b72 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:24:36.955851 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-94dd3260-2d60-4e8b-af74-bb00931b0b72 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: a825ddeb-ecda-4e57-94ed-84f48c6942d0] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:24:36.962597 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-94dd3260-2d60-4e8b-af74-bb00931b0b72 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:36.963086 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-94dd3260-2d60-4e8b-af74-bb00931b0b72 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:36.963869 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-94dd3260-2d60-4e8b-af74-bb00931b0b72 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:36.964328 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-94dd3260-2d60-4e8b-af74-bb00931b0b72 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:37.097994 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-94dd3260-2d60-4e8b-af74-bb00931b0b72 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:24:37.105529 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-94dd3260-2d60-4e8b-af74-bb00931b0b72 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0" status: 200 len: 1367 microversion: 2.1 time: 0.154199 Aug 03 19:24:37.106081 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 507/1011] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:24:36 2022] GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:24:38.126372 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-8996bfa3-741a-47f3-986b-2e17b7706d7c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:24:38.126998 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-8996bfa3-741a-47f3-986b-2e17b7706d7c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: a825ddeb-ecda-4e57-94ed-84f48c6942d0] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:24:38.135587 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8996bfa3-741a-47f3-986b-2e17b7706d7c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:38.136046 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8996bfa3-741a-47f3-986b-2e17b7706d7c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:38.136805 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8996bfa3-741a-47f3-986b-2e17b7706d7c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:38.137235 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8996bfa3-741a-47f3-986b-2e17b7706d7c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:38.273234 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-8996bfa3-741a-47f3-986b-2e17b7706d7c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:24:38.280611 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-8996bfa3-741a-47f3-986b-2e17b7706d7c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0" status: 200 len: 1367 microversion: 2.1 time: 0.158109 Aug 03 19:24:38.281179 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 505/1012] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:24:38 2022] GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:24:39.301280 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-55194d24-599c-4e61-aab5-0350c447ab50 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:24:39.301913 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-55194d24-599c-4e61-aab5-0350c447ab50 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: a825ddeb-ecda-4e57-94ed-84f48c6942d0] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:24:39.308395 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-55194d24-599c-4e61-aab5-0350c447ab50 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:39.308841 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-55194d24-599c-4e61-aab5-0350c447ab50 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:39.309598 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-55194d24-599c-4e61-aab5-0350c447ab50 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:39.310027 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-55194d24-599c-4e61-aab5-0350c447ab50 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:39.449802 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-55194d24-599c-4e61-aab5-0350c447ab50 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:24:39.458032 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-55194d24-599c-4e61-aab5-0350c447ab50 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0" status: 200 len: 1367 microversion: 2.1 time: 0.161000 Aug 03 19:24:39.458607 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 508/1013] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:24:39 2022] GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:24:40.479930 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-236ea5d9-5338-4d75-9862-907f5e0847e5 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:24:40.480546 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-236ea5d9-5338-4d75-9862-907f5e0847e5 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: a825ddeb-ecda-4e57-94ed-84f48c6942d0] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:24:40.482977 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell0:SELECT=6 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:24:40.487857 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-236ea5d9-5338-4d75-9862-907f5e0847e5 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:40.488919 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-236ea5d9-5338-4d75-9862-907f5e0847e5 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:40.489688 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-236ea5d9-5338-4d75-9862-907f5e0847e5 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:40.490176 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-236ea5d9-5338-4d75-9862-907f5e0847e5 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:40.624519 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-236ea5d9-5338-4d75-9862-907f5e0847e5 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:24:40.632253 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-236ea5d9-5338-4d75-9862-907f5e0847e5 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0" status: 200 len: 1367 microversion: 2.1 time: 0.156301 Aug 03 19:24:40.632814 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 506/1014] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:24:40 2022] GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:24:41.499542 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [req-1bc206a9-9220-4fe5-a769-3a9de6523e6e req-d8c8cceb-4758-4003-a6d6-b2bcb2d3783c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a825ddeb-ecda-4e57-94ed-84f48c6942d0", "name": "network-vif-plugged", "status": "completed", "tag": "56855336-a61c-45fa-beeb-54fd8e553b52"}]} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:24:41.505101 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell0:SELECT=2 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:24:41.505845 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell0:SELECT=6 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:24:41.507004 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:24:41.512338 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-1bc206a9-9220-4fe5-a769-3a9de6523e6e req-d8c8cceb-4758-4003-a6d6-b2bcb2d3783c service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:41.512782 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-1bc206a9-9220-4fe5-a769-3a9de6523e6e req-d8c8cceb-4758-4003-a6d6-b2bcb2d3783c service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:41.515320 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:24:41.524398 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.compute.server_external_events [req-1bc206a9-9220-4fe5-a769-3a9de6523e6e req-d8c8cceb-4758-4003-a6d6-b2bcb2d3783c service nova] Creating event network-vif-plugged:56855336-a61c-45fa-beeb-54fd8e553b52 for instance a825ddeb-ecda-4e57-94ed-84f48c6942d0 on hv-cinder-85202 Aug 03 19:24:41.529458 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [req-1bc206a9-9220-4fe5-a769-3a9de6523e6e req-d8c8cceb-4758-4003-a6d6-b2bcb2d3783c service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034293 Aug 03 19:24:41.531306 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 509/1015] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:24:41.665383 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-83890101-9698-4f83-8120-e7114dce062c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:24:41.665988 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-83890101-9698-4f83-8120-e7114dce062c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: a825ddeb-ecda-4e57-94ed-84f48c6942d0] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:24:41.672420 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-83890101-9698-4f83-8120-e7114dce062c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:41.672864 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-83890101-9698-4f83-8120-e7114dce062c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:41.673613 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-83890101-9698-4f83-8120-e7114dce062c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:41.674046 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-83890101-9698-4f83-8120-e7114dce062c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:41.808832 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-83890101-9698-4f83-8120-e7114dce062c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:24:41.816758 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-83890101-9698-4f83-8120-e7114dce062c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0" status: 200 len: 1367 microversion: 2.1 time: 0.155968 Aug 03 19:24:41.817348 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 507/1016] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:24:41 2022] GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:24:42.837892 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-2423d1df-3da5-475f-bbb3-94f42241ee50 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:24:42.838577 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-2423d1df-3da5-475f-bbb3-94f42241ee50 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: a825ddeb-ecda-4e57-94ed-84f48c6942d0] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:24:42.846902 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2423d1df-3da5-475f-bbb3-94f42241ee50 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:42.847369 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2423d1df-3da5-475f-bbb3-94f42241ee50 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:42.848175 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2423d1df-3da5-475f-bbb3-94f42241ee50 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:42.848713 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2423d1df-3da5-475f-bbb3-94f42241ee50 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:42.981667 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-2423d1df-3da5-475f-bbb3-94f42241ee50 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:24:42.989674 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-2423d1df-3da5-475f-bbb3-94f42241ee50 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0" status: 200 len: 1367 microversion: 2.1 time: 0.156951 Aug 03 19:24:42.990338 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 510/1017] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:24:42 2022] GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:24:44.010586 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-145b1c7f-81f3-4264-9c59-8ad7cfb0897c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:24:44.011225 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-145b1c7f-81f3-4264-9c59-8ad7cfb0897c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: a825ddeb-ecda-4e57-94ed-84f48c6942d0] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:24:44.017992 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-145b1c7f-81f3-4264-9c59-8ad7cfb0897c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:44.018432 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-145b1c7f-81f3-4264-9c59-8ad7cfb0897c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:44.019249 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-145b1c7f-81f3-4264-9c59-8ad7cfb0897c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:44.019733 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-145b1c7f-81f3-4264-9c59-8ad7cfb0897c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:44.152340 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-145b1c7f-81f3-4264-9c59-8ad7cfb0897c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:24:44.159907 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-145b1c7f-81f3-4264-9c59-8ad7cfb0897c tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0" status: 200 len: 1557 microversion: 2.1 time: 0.153248 Aug 03 19:24:44.161084 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 508/1018] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:24:44 2022] GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:24:44.182232 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-ca5a54ae-e6da-45b5-bf26-242fefbb9221 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:24:44.183023 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-ca5a54ae-e6da-45b5-bf26-242fefbb9221 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: a825ddeb-ecda-4e57-94ed-84f48c6942d0] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:24:44.190522 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ca5a54ae-e6da-45b5-bf26-242fefbb9221 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:44.190988 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ca5a54ae-e6da-45b5-bf26-242fefbb9221 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:44.192448 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ca5a54ae-e6da-45b5-bf26-242fefbb9221 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:44.192897 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ca5a54ae-e6da-45b5-bf26-242fefbb9221 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:44.272906 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-ca5a54ae-e6da-45b5-bf26-242fefbb9221 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096555 Aug 03 19:24:44.273499 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 511/1019] 10.222.0.77 () {58 vars in 1275 bytes} [Wed Aug 3 19:24:44 2022] GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:24:45.352081 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-acbc82d2-a6c1-47ff-8e24-85e27070eb44 req-3161e556-3ae4-45a2-9e8b-fc6a9cb70c0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a825ddeb-ecda-4e57-94ed-84f48c6942d0", "tag": "56855336-a61c-45fa-beeb-54fd8e553b52"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:24:45.361894 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-acbc82d2-a6c1-47ff-8e24-85e27070eb44 req-3161e556-3ae4-45a2-9e8b-fc6a9cb70c0a service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:24:45.362418 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-acbc82d2-a6c1-47ff-8e24-85e27070eb44 req-3161e556-3ae4-45a2-9e8b-fc6a9cb70c0a service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:24:45.378326 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-acbc82d2-a6c1-47ff-8e24-85e27070eb44 req-3161e556-3ae4-45a2-9e8b-fc6a9cb70c0a service nova] Creating event network-changed:56855336-a61c-45fa-beeb-54fd8e553b52 for instance a825ddeb-ecda-4e57-94ed-84f48c6942d0 on hv-cinder-85202 Aug 03 19:24:45.386378 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-acbc82d2-a6c1-47ff-8e24-85e27070eb44 req-3161e556-3ae4-45a2-9e8b-fc6a9cb70c0a service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038148 Aug 03 19:24:45.387277 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 509/1020] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:25:50.254032 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_api:SELECT=5 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:25:50.254908 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=11 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:25:50.261802 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-e91080c1-6db5-4d3e-aff6-80997d2cad79 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:25:50.261802 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-e91080c1-6db5-4d3e-aff6-80997d2cad79 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: a825ddeb-ecda-4e57-94ed-84f48c6942d0] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:25:50.265396 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e91080c1-6db5-4d3e-aff6-80997d2cad79 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:25:50.265846 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e91080c1-6db5-4d3e-aff6-80997d2cad79 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:25:50.266721 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e91080c1-6db5-4d3e-aff6-80997d2cad79 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:25:50.267183 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e91080c1-6db5-4d3e-aff6-80997d2cad79 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:25:50.290553 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-e91080c1-6db5-4d3e-aff6-80997d2cad79 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0/ips" status: 200 len: 149 microversion: 2.1 time: 0.038430 Aug 03 19:25:50.291150 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 512/1021] 10.222.0.77 () {58 vars in 1248 bytes} [Wed Aug 3 19:25:50 2022] GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:25:52.949592 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:25:52.950338 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:25:52.955172 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-f65efd24-a186-4932-8b63-f1f526152e94 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6cd95c7e-f283-4dea-8057-66ac303cdd74"}} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:25:52.957558 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-f65efd24-a186-4932-8b63-f1f526152e94 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: a825ddeb-ecda-4e57-94ed-84f48c6942d0] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:25:52.963742 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f65efd24-a186-4932-8b63-f1f526152e94 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:25:52.969827 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f65efd24-a186-4932-8b63-f1f526152e94 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:25:52.969827 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f65efd24-a186-4932-8b63-f1f526152e94 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:25:52.969827 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f65efd24-a186-4932-8b63-f1f526152e94 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:25:53.734613 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-f65efd24-a186-4932-8b63-f1f526152e94 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "POST /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.786610 Aug 03 19:25:53.735418 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 510/1022] 10.222.0.77 () {60 vars in 1323 bytes} [Wed Aug 3 19:25:52 2022] POST /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0/os-volume_attachments => generated 194 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:26:01.357473 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-3205f069-a089-450b-9d22-eb8443f253c4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:26:01.357960 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-3205f069-a089-450b-9d22-eb8443f253c4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: a825ddeb-ecda-4e57-94ed-84f48c6942d0] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:26:01.366076 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3205f069-a089-450b-9d22-eb8443f253c4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:26:01.366545 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3205f069-a089-450b-9d22-eb8443f253c4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:26:01.367333 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3205f069-a089-450b-9d22-eb8443f253c4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:26:01.367767 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3205f069-a089-450b-9d22-eb8443f253c4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:26:01.448293 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.objects.instance [None req-3205f069-a089-450b-9d22-eb8443f253c4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lazy-loading 'services' on Instance uuid a825ddeb-ecda-4e57-94ed-84f48c6942d0 {{(pid=118303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:26:01.642967 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-3205f069-a089-450b-9d22-eb8443f253c4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "DELETE /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0/os-volume_attachments/6cd95c7e-f283-4dea-8057-66ac303cdd74" status: 202 len: 0 microversion: 2.1 time: 0.288371 Aug 03 19:26:01.643588 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 513/1023] 10.222.0.77 () {58 vars in 1416 bytes} [Wed Aug 3 19:26:01 2022] DELETE /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0/os-volume_attachments/6cd95c7e-f283-4dea-8057-66ac303cdd74 => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 19:26:01.653935 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-eac9c342-25bc-4a98-baa6-96c9dd7d8c81 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:26:01.656396 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-eac9c342-25bc-4a98-baa6-96c9dd7d8c81 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: a825ddeb-ecda-4e57-94ed-84f48c6942d0] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:26:01.663357 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-eac9c342-25bc-4a98-baa6-96c9dd7d8c81 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:26:01.663806 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-eac9c342-25bc-4a98-baa6-96c9dd7d8c81 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:26:01.664576 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-eac9c342-25bc-4a98-baa6-96c9dd7d8c81 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:26:01.665012 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-eac9c342-25bc-4a98-baa6-96c9dd7d8c81 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:26:01.695083 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-eac9c342-25bc-4a98-baa6-96c9dd7d8c81 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046251 Aug 03 19:26:01.695637 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 511/1024] 10.222.0.77 () {58 vars in 1302 bytes} [Wed Aug 3 19:26:01 2022] GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:26:02.708566 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-379750e8-884c-4ab5-a4bb-be53d637eff4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:26:02.710902 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-379750e8-884c-4ab5-a4bb-be53d637eff4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: a825ddeb-ecda-4e57-94ed-84f48c6942d0] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:26:02.717746 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-379750e8-884c-4ab5-a4bb-be53d637eff4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:26:02.718206 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-379750e8-884c-4ab5-a4bb-be53d637eff4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:26:02.719044 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-379750e8-884c-4ab5-a4bb-be53d637eff4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:26:02.719487 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-379750e8-884c-4ab5-a4bb-be53d637eff4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:26:02.749161 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-379750e8-884c-4ab5-a4bb-be53d637eff4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045209 Aug 03 19:26:02.749706 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 514/1025] 10.222.0.77 () {58 vars in 1302 bytes} [Wed Aug 3 19:26:02 2022] GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:26:03.761371 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-59a711cd-6286-41ee-8a39-d68a9163ffb4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:26:03.763569 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-59a711cd-6286-41ee-8a39-d68a9163ffb4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: a825ddeb-ecda-4e57-94ed-84f48c6942d0] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:26:03.770774 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-59a711cd-6286-41ee-8a39-d68a9163ffb4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:26:03.771257 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-59a711cd-6286-41ee-8a39-d68a9163ffb4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:26:03.772037 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-59a711cd-6286-41ee-8a39-d68a9163ffb4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:26:03.772469 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-59a711cd-6286-41ee-8a39-d68a9163ffb4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:26:03.803756 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-59a711cd-6286-41ee-8a39-d68a9163ffb4 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046311 Aug 03 19:26:03.804309 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 512/1026] 10.222.0.77 () {58 vars in 1302 bytes} [Wed Aug 3 19:26:03 2022] GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 19:26:03.866939 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-a056c7d3-26f5-45dc-89b9-b927a545e131 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:26:03.867513 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-a056c7d3-26f5-45dc-89b9-b927a545e131 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: a825ddeb-ecda-4e57-94ed-84f48c6942d0] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:26:03.874011 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a056c7d3-26f5-45dc-89b9-b927a545e131 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:26:03.874590 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a056c7d3-26f5-45dc-89b9-b927a545e131 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:26:03.875401 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a056c7d3-26f5-45dc-89b9-b927a545e131 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:26:03.875844 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a056c7d3-26f5-45dc-89b9-b927a545e131 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:26:03.901883 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-a056c7d3-26f5-45dc-89b9-b927a545e131 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: a825ddeb-ecda-4e57-94ed-84f48c6942d0] Going to try to terminate instance {{(pid=118303) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 19:26:04.119511 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-a056c7d3-26f5-45dc-89b9-b927a545e131 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "DELETE /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0" status: 204 len: 0 microversion: 2.1 time: 0.256097 Aug 03 19:26:04.120096 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 515/1027] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 3 19:26:03 2022] DELETE /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 19:26:04.129072 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-a0c527b4-a01a-4f7c-9a40-63522ff15210 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:26:04.134303 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-a0c527b4-a01a-4f7c-9a40-63522ff15210 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: a825ddeb-ecda-4e57-94ed-84f48c6942d0] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:26:04.135937 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a0c527b4-a01a-4f7c-9a40-63522ff15210 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:26:04.136395 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a0c527b4-a01a-4f7c-9a40-63522ff15210 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:26:04.137163 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a0c527b4-a01a-4f7c-9a40-63522ff15210 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:26:04.137679 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a0c527b4-a01a-4f7c-9a40-63522ff15210 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:26:04.274348 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-a0c527b4-a01a-4f7c-9a40-63522ff15210 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:26:04.282053 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-a0c527b4-a01a-4f7c-9a40-63522ff15210 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0" status: 200 len: 1681 microversion: 2.1 time: 0.157454 Aug 03 19:26:04.283184 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 513/1028] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:26:04 2022] GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:26:05.304246 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-3690c8e8-4d6c-4701-878b-1a5cdcf9f765 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:26:05.304943 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-3690c8e8-4d6c-4701-878b-1a5cdcf9f765 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: a825ddeb-ecda-4e57-94ed-84f48c6942d0] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:26:05.311379 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3690c8e8-4d6c-4701-878b-1a5cdcf9f765 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:26:05.311826 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3690c8e8-4d6c-4701-878b-1a5cdcf9f765 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:26:05.312589 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3690c8e8-4d6c-4701-878b-1a5cdcf9f765 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:26:05.313022 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3690c8e8-4d6c-4701-878b-1a5cdcf9f765 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:26:05.447452 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-3690c8e8-4d6c-4701-878b-1a5cdcf9f765 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:26:05.455588 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-3690c8e8-4d6c-4701-878b-1a5cdcf9f765 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0" status: 200 len: 1681 microversion: 2.1 time: 0.155607 Aug 03 19:26:05.456150 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 516/1029] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:26:05 2022] GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:26:06.477204 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-dd4c2e72-e610-4221-b1f9-729a273315c1 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:26:06.477913 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-dd4c2e72-e610-4221-b1f9-729a273315c1 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: a825ddeb-ecda-4e57-94ed-84f48c6942d0] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:26:06.485437 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-dd4c2e72-e610-4221-b1f9-729a273315c1 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:26:06.486125 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-dd4c2e72-e610-4221-b1f9-729a273315c1 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:26:06.489124 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-dd4c2e72-e610-4221-b1f9-729a273315c1 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:26:06.489124 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-dd4c2e72-e610-4221-b1f9-729a273315c1 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:26:06.632956 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-dd4c2e72-e610-4221-b1f9-729a273315c1 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:26:06.643428 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-dd4c2e72-e610-4221-b1f9-729a273315c1 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0" status: 200 len: 1681 microversion: 2.1 time: 0.170072 Aug 03 19:26:06.644010 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 514/1030] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:26:06 2022] GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:26:07.175333 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [req-5a6884e6-73f2-413b-b5f2-8914a930ef57 req-3d3fea9f-d91e-41ae-b90c-a7274bbaa53f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a825ddeb-ecda-4e57-94ed-84f48c6942d0", "name": "network-vif-deleted", "tag": "56855336-a61c-45fa-beeb-54fd8e553b52"}]} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:26:07.185130 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-5a6884e6-73f2-413b-b5f2-8914a930ef57 req-3d3fea9f-d91e-41ae-b90c-a7274bbaa53f service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:26:07.185679 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-5a6884e6-73f2-413b-b5f2-8914a930ef57 req-3d3fea9f-d91e-41ae-b90c-a7274bbaa53f service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:26:07.198357 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.compute.server_external_events [req-5a6884e6-73f2-413b-b5f2-8914a930ef57 req-3d3fea9f-d91e-41ae-b90c-a7274bbaa53f service nova] Creating event network-vif-deleted:56855336-a61c-45fa-beeb-54fd8e553b52 for instance a825ddeb-ecda-4e57-94ed-84f48c6942d0 on hv-cinder-85202 Aug 03 19:26:07.203646 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [req-5a6884e6-73f2-413b-b5f2-8914a930ef57 req-3d3fea9f-d91e-41ae-b90c-a7274bbaa53f service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032153 Aug 03 19:26:07.204245 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 517/1031] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:26:07.665340 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-af1deb49-2e15-4b40-94ee-f910f7958422 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:26:07.665959 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-af1deb49-2e15-4b40-94ee-f910f7958422 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: a825ddeb-ecda-4e57-94ed-84f48c6942d0] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:26:07.672475 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-af1deb49-2e15-4b40-94ee-f910f7958422 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:26:07.672929 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-af1deb49-2e15-4b40-94ee-f910f7958422 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:26:07.674284 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-af1deb49-2e15-4b40-94ee-f910f7958422 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:26:07.674705 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-af1deb49-2e15-4b40-94ee-f910f7958422 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:26:07.706229 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-af1deb49-2e15-4b40-94ee-f910f7958422 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:26:07.706681 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-af1deb49-2e15-4b40-94ee-f910f7958422 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:26:07.707182 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.objects.instance [None req-af1deb49-2e15-4b40-94ee-f910f7958422 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lazy-loading 'fault' on Instance uuid a825ddeb-ecda-4e57-94ed-84f48c6942d0 {{(pid=118302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:26:07.747576 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-af1deb49-2e15-4b40-94ee-f910f7958422 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32425eddf65f477db53594f7d4b447e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e02e6595d2284de190bb759806ca02f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:26:07.756114 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-af1deb49-2e15-4b40-94ee-f910f7958422 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0" status: 200 len: 1331 microversion: 2.1 time: 0.094624 Aug 03 19:26:07.756679 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 515/1032] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:26:07 2022] GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0 => generated 1331 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:26:08.778297 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-799bc5b5-0e5a-4515-abf7-978b3d27b0b9 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:26:08.779027 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-799bc5b5-0e5a-4515-abf7-978b3d27b0b9 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: a825ddeb-ecda-4e57-94ed-84f48c6942d0] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:26:08.785982 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-799bc5b5-0e5a-4515-abf7-978b3d27b0b9 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:26:08.786434 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-799bc5b5-0e5a-4515-abf7-978b3d27b0b9 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:26:08.787237 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-799bc5b5-0e5a-4515-abf7-978b3d27b0b9 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:26:08.787675 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-799bc5b5-0e5a-4515-abf7-978b3d27b0b9 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:26:08.801525 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.wsgi [None req-799bc5b5-0e5a-4515-abf7-978b3d27b0b9 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] HTTP exception thrown: Instance a825ddeb-ecda-4e57-94ed-84f48c6942d0 could not be found. Aug 03 19:26:08.803178 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-799bc5b5-0e5a-4515-abf7-978b3d27b0b9 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Request method failure captured: Aug 03 19:26:08.803178 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: request: GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0 HTTP/1.1 Aug 03 19:26:08.803178 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept: application/json Aug 03 19:26:08.803178 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept-Encoding: identity Aug 03 19:26:08.803178 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Connection: close Aug 03 19:26:08.803178 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Length: 0 Aug 03 19:26:08.803178 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Type: application/json Aug 03 19:26:08.803178 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Host: 10.222.0.77 Aug 03 19:26:08.803178 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Openstack-System-Scope: None Aug 03 19:26:08.803178 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: User-Agent: python-urllib3/1.26.11 Aug 03 19:26:08.803178 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Auth-Token: gAAAAABi6soo3tVsyMpp4Q5BeVYgBkb-ZmSXfFqqDLxngfO69yiJ0ybu4b_gQBD6U7zMaZpKagPnF0tkOMv2DMg2Ki8vJ6bAkRfUIOgz6V1xoe8gX_F1YIssVOFX-QTa-WpQkCCkJJtYSX1EJo1Xmv5e_ntC-Qe1WtL2fOzOa0FpdkQ5uZgdkSk Aug 03 19:26:08.803178 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Id: None Aug 03 19:26:08.803178 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Name: None Aug 03 19:26:08.803178 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Identity-Status: Confirmed Aug 03 19:26:08.803178 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Is-Admin-Project: True Aug 03 19:26:08.803178 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Id: default Aug 03 19:26:08.803178 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Name: Default Aug 03 19:26:08.803178 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Id: e02e6595d2284de190bb759806ca02f6 Aug 03 19:26:08.803178 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Name: tempest-AttachVolumeNegativeTest-1363049785 Aug 03 19:26:08.803178 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Role: reader,member Aug 03 19:26:08.803178 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Roles: reader,member Aug 03 19:26:08.804690 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_e02e6595d2284de190bb759806ca02f6", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/e02e6595d2284de190bb759806ca02f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/e02e6595d2284de190bb759806ca02f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/e02e6595d2284de190bb759806ca02f6"}]}] Aug 03 19:26:08.804690 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant: tempest-AttachVolumeNegativeTest-1363049785 Aug 03 19:26:08.804690 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Id: e02e6595d2284de190bb759806ca02f6 Aug 03 19:26:08.804690 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1363049785 Aug 03 19:26:08.804690 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User: tempest-AttachVolumeNegativeTest-1363049785-project Aug 03 19:26:08.804690 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Id: default Aug 03 19:26:08.804690 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Name: Default Aug 03 19:26:08.804690 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Id: 32425eddf65f477db53594f7d4b447e2 Aug 03 19:26:08.804690 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Name: tempest-AttachVolumeNegativeTest-1363049785-project Aug 03 19:26:08.804690 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: method: > Aug 03 19:26:08.804690 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: exception: Instance a825ddeb-ecda-4e57-94ed-84f48c6942d0 could not be found. Aug 03 19:26:08.804690 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: action_args: {'id': 'a825ddeb-ecda-4e57-94ed-84f48c6942d0'} Aug 03 19:26:08.805571 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:26:08.805571 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:26:08.805571 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:26:08.805571 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:26:08.805571 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:26:08.805571 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:26:08.805571 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:26:08.805571 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:26:08.805571 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:26:08.805571 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:26:08.805571 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a825ddeb-ecda-4e57-94ed-84f48c6942d0 could not be found. Aug 03 19:26:08.805571 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:26:08.805571 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:26:08.805571 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:26:08.805571 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:26:08.805571 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:26:08.805571 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:26:08.805571 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:26:08.805571 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:26:08.805571 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:26:08.807233 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:26:08.807233 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:26:08.807233 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:26:08.807233 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:26:08.807233 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:26:08.807233 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:26:08.807233 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:26:08.807233 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a825ddeb-ecda-4e57-94ed-84f48c6942d0 could not be found. Aug 03 19:26:08.807233 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:26:08.807233 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:26:08.807233 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:26:08.807233 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:26:08.807233 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:26:08.807233 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:26:08.807233 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:26:08.807233 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:26:08.807233 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a825ddeb-ecda-4e57-94ed-84f48c6942d0 could not be found. Aug 03 19:26:08.807233 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:26:08.808778 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-799bc5b5-0e5a-4515-abf7-978b3d27b0b9 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Returning 404 to user: Instance a825ddeb-ecda-4e57-94ed-84f48c6942d0 could not be found. {{(pid=118303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:26:08.808778 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-799bc5b5-0e5a-4515-abf7-978b3d27b0b9 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0" status: 404 len: 111 microversion: 2.1 time: 0.031032 Aug 03 19:26:08.808778 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 518/1033] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:26:08 2022] GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:26:08.813878 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-ff6ba9d3-0a17-472b-93dd-d9a4f94e109b tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '.version_select at 0x7f47862ebe50>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:26:08.918343 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-ff6ba9d3-0a17-472b-93dd-d9a4f94e109b tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-744757441" status: 202 len: 0 microversion: 2.1 time: 0.108691 Aug 03 19:26:08.918917 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 516/1034] 10.222.0.77 () {58 vars in 1218 bytes} [Wed Aug 3 19:26:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-744757441 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 19:26:11.268951 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-a8d04b42-d45a-4640-950f-79b8ca34e0b0 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:26:11.269448 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-a8d04b42-d45a-4640-950f-79b8ca34e0b0 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: a825ddeb-ecda-4e57-94ed-84f48c6942d0] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:26:11.275880 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a8d04b42-d45a-4640-950f-79b8ca34e0b0 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:26:11.276328 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a8d04b42-d45a-4640-950f-79b8ca34e0b0 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:26:11.277075 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a8d04b42-d45a-4640-950f-79b8ca34e0b0 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:26:11.277502 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a8d04b42-d45a-4640-950f-79b8ca34e0b0 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:26:11.291507 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.wsgi [None req-a8d04b42-d45a-4640-950f-79b8ca34e0b0 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] HTTP exception thrown: Instance a825ddeb-ecda-4e57-94ed-84f48c6942d0 could not be found. Aug 03 19:26:11.292993 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-a8d04b42-d45a-4640-950f-79b8ca34e0b0 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Request method failure captured: Aug 03 19:26:11.292993 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: request: DELETE /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0 HTTP/1.1 Aug 03 19:26:11.292993 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept: application/json Aug 03 19:26:11.292993 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept-Encoding: identity Aug 03 19:26:11.292993 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Connection: close Aug 03 19:26:11.292993 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Length: 0 Aug 03 19:26:11.292993 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Type: application/json Aug 03 19:26:11.292993 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Host: 10.222.0.77 Aug 03 19:26:11.292993 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Openstack-System-Scope: None Aug 03 19:26:11.292993 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: User-Agent: python-urllib3/1.26.11 Aug 03 19:26:11.292993 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Auth-Token: gAAAAABi6soo3tVsyMpp4Q5BeVYgBkb-ZmSXfFqqDLxngfO69yiJ0ybu4b_gQBD6U7zMaZpKagPnF0tkOMv2DMg2Ki8vJ6bAkRfUIOgz6V1xoe8gX_F1YIssVOFX-QTa-WpQkCCkJJtYSX1EJo1Xmv5e_ntC-Qe1WtL2fOzOa0FpdkQ5uZgdkSk Aug 03 19:26:11.292993 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Id: None Aug 03 19:26:11.292993 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Name: None Aug 03 19:26:11.292993 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Identity-Status: Confirmed Aug 03 19:26:11.292993 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Is-Admin-Project: True Aug 03 19:26:11.292993 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Id: default Aug 03 19:26:11.292993 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Name: Default Aug 03 19:26:11.292993 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Id: e02e6595d2284de190bb759806ca02f6 Aug 03 19:26:11.292993 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Name: tempest-AttachVolumeNegativeTest-1363049785 Aug 03 19:26:11.292993 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Role: reader,member Aug 03 19:26:11.292993 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Roles: reader,member Aug 03 19:26:11.294691 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_e02e6595d2284de190bb759806ca02f6", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/e02e6595d2284de190bb759806ca02f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/e02e6595d2284de190bb759806ca02f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/e02e6595d2284de190bb759806ca02f6"}]}] Aug 03 19:26:11.294691 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant: tempest-AttachVolumeNegativeTest-1363049785 Aug 03 19:26:11.294691 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Id: e02e6595d2284de190bb759806ca02f6 Aug 03 19:26:11.294691 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1363049785 Aug 03 19:26:11.294691 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User: tempest-AttachVolumeNegativeTest-1363049785-project Aug 03 19:26:11.294691 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Id: default Aug 03 19:26:11.294691 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Name: Default Aug 03 19:26:11.294691 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Id: 32425eddf65f477db53594f7d4b447e2 Aug 03 19:26:11.294691 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Name: tempest-AttachVolumeNegativeTest-1363049785-project Aug 03 19:26:11.294691 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: method: > Aug 03 19:26:11.294691 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: exception: Instance a825ddeb-ecda-4e57-94ed-84f48c6942d0 could not be found. Aug 03 19:26:11.294691 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: action_args: {'id': 'a825ddeb-ecda-4e57-94ed-84f48c6942d0'} Aug 03 19:26:11.295564 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:26:11.295564 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:26:11.295564 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:26:11.295564 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:26:11.295564 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:26:11.295564 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:26:11.295564 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:26:11.295564 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:26:11.295564 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:26:11.295564 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:26:11.295564 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a825ddeb-ecda-4e57-94ed-84f48c6942d0 could not be found. Aug 03 19:26:11.295564 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:26:11.295564 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:26:11.295564 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:26:11.295564 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:26:11.295564 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:26:11.295564 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:26:11.295564 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:26:11.295564 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:26:11.295564 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:26:11.296860 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:26:11.296860 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 19:26:11.296860 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 19:26:11.296860 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 19:26:11.296860 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 19:26:11.296860 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:26:11.296860 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:26:11.296860 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:26:11.296860 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:26:11.296860 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a825ddeb-ecda-4e57-94ed-84f48c6942d0 could not be found. Aug 03 19:26:11.296860 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:26:11.296860 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:26:11.296860 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:26:11.296860 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:26:11.296860 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:26:11.296860 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:26:11.296860 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:26:11.296860 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:26:11.296860 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a825ddeb-ecda-4e57-94ed-84f48c6942d0 could not be found. Aug 03 19:26:11.296860 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:26:11.298200 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-a8d04b42-d45a-4640-950f-79b8ca34e0b0 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Returning 404 to user: Instance a825ddeb-ecda-4e57-94ed-84f48c6942d0 could not be found. {{(pid=118303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:26:11.298200 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-a8d04b42-d45a-4640-950f-79b8ca34e0b0 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "DELETE /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0" status: 404 len: 111 microversion: 2.1 time: 0.029527 Aug 03 19:26:11.298200 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 519/1035] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 3 19:26:11 2022] DELETE /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:26:11.303935 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-3eb73e46-76d6-4426-bf14-2394f75a0bad tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:26:11.304556 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-3eb73e46-76d6-4426-bf14-2394f75a0bad tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: a825ddeb-ecda-4e57-94ed-84f48c6942d0] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:26:11.311315 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3eb73e46-76d6-4426-bf14-2394f75a0bad tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:26:11.311773 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3eb73e46-76d6-4426-bf14-2394f75a0bad tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:26:11.312537 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3eb73e46-76d6-4426-bf14-2394f75a0bad tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:26:11.312978 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-3eb73e46-76d6-4426-bf14-2394f75a0bad tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:26:11.326495 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.wsgi [None req-3eb73e46-76d6-4426-bf14-2394f75a0bad tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] HTTP exception thrown: Instance a825ddeb-ecda-4e57-94ed-84f48c6942d0 could not be found. Aug 03 19:26:11.328153 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-3eb73e46-76d6-4426-bf14-2394f75a0bad tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Request method failure captured: Aug 03 19:26:11.328153 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: request: GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0 HTTP/1.1 Aug 03 19:26:11.328153 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept: application/json Aug 03 19:26:11.328153 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept-Encoding: identity Aug 03 19:26:11.328153 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Connection: close Aug 03 19:26:11.328153 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Length: 0 Aug 03 19:26:11.328153 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Type: application/json Aug 03 19:26:11.328153 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Host: 10.222.0.77 Aug 03 19:26:11.328153 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Openstack-System-Scope: None Aug 03 19:26:11.328153 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: User-Agent: python-urllib3/1.26.11 Aug 03 19:26:11.328153 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Auth-Token: gAAAAABi6soo3tVsyMpp4Q5BeVYgBkb-ZmSXfFqqDLxngfO69yiJ0ybu4b_gQBD6U7zMaZpKagPnF0tkOMv2DMg2Ki8vJ6bAkRfUIOgz6V1xoe8gX_F1YIssVOFX-QTa-WpQkCCkJJtYSX1EJo1Xmv5e_ntC-Qe1WtL2fOzOa0FpdkQ5uZgdkSk Aug 03 19:26:11.328153 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Id: None Aug 03 19:26:11.328153 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Name: None Aug 03 19:26:11.328153 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Identity-Status: Confirmed Aug 03 19:26:11.328153 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Is-Admin-Project: True Aug 03 19:26:11.328153 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Id: default Aug 03 19:26:11.328153 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Name: Default Aug 03 19:26:11.328153 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Id: e02e6595d2284de190bb759806ca02f6 Aug 03 19:26:11.328153 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Name: tempest-AttachVolumeNegativeTest-1363049785 Aug 03 19:26:11.328153 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Role: reader,member Aug 03 19:26:11.328153 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Roles: reader,member Aug 03 19:26:11.329917 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_e02e6595d2284de190bb759806ca02f6", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/e02e6595d2284de190bb759806ca02f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/e02e6595d2284de190bb759806ca02f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/e02e6595d2284de190bb759806ca02f6"}]}] Aug 03 19:26:11.329917 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant: tempest-AttachVolumeNegativeTest-1363049785 Aug 03 19:26:11.329917 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Id: e02e6595d2284de190bb759806ca02f6 Aug 03 19:26:11.329917 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1363049785 Aug 03 19:26:11.329917 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User: tempest-AttachVolumeNegativeTest-1363049785-project Aug 03 19:26:11.329917 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Id: default Aug 03 19:26:11.329917 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Name: Default Aug 03 19:26:11.329917 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Id: 32425eddf65f477db53594f7d4b447e2 Aug 03 19:26:11.329917 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Name: tempest-AttachVolumeNegativeTest-1363049785-project Aug 03 19:26:11.329917 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: method: > Aug 03 19:26:11.329917 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: exception: Instance a825ddeb-ecda-4e57-94ed-84f48c6942d0 could not be found. Aug 03 19:26:11.329917 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: action_args: {'id': 'a825ddeb-ecda-4e57-94ed-84f48c6942d0'} Aug 03 19:26:11.330907 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:26:11.330907 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:26:11.330907 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:26:11.330907 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:26:11.330907 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:26:11.330907 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:26:11.330907 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:26:11.330907 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:26:11.330907 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:26:11.330907 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:26:11.330907 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a825ddeb-ecda-4e57-94ed-84f48c6942d0 could not be found. Aug 03 19:26:11.330907 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:26:11.330907 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:26:11.330907 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:26:11.330907 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:26:11.330907 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:26:11.330907 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:26:11.330907 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:26:11.330907 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:26:11.330907 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:26:11.332474 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:26:11.332474 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:26:11.332474 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:26:11.332474 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:26:11.332474 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:26:11.332474 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:26:11.332474 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:26:11.332474 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a825ddeb-ecda-4e57-94ed-84f48c6942d0 could not be found. Aug 03 19:26:11.332474 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:26:11.332474 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:26:11.332474 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:26:11.332474 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:26:11.332474 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:26:11.332474 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:26:11.332474 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:26:11.332474 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:26:11.332474 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a825ddeb-ecda-4e57-94ed-84f48c6942d0 could not be found. Aug 03 19:26:11.332474 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:26:11.333826 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-3eb73e46-76d6-4426-bf14-2394f75a0bad tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Returning 404 to user: Instance a825ddeb-ecda-4e57-94ed-84f48c6942d0 could not be found. {{(pid=118302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:26:11.333826 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-3eb73e46-76d6-4426-bf14-2394f75a0bad tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0" status: 404 len: 111 microversion: 2.1 time: 0.029932 Aug 03 19:26:11.333826 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 517/1036] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:26:11 2022] GET /compute/v2.1/servers/a825ddeb-ecda-4e57-94ed-84f48c6942d0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:26:12.634017 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-e31af29c-57e4-4534-942a-3eb9ab43589d tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:26:12.634522 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-e31af29c-57e4-4534-942a-3eb9ab43589d tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 160754d3-09be-409f-acb5-7f7acc57bfc1] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:26:12.641082 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e31af29c-57e4-4534-942a-3eb9ab43589d tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:26:12.641535 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e31af29c-57e4-4534-942a-3eb9ab43589d tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:26:12.642302 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e31af29c-57e4-4534-942a-3eb9ab43589d tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:26:12.642743 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-e31af29c-57e4-4534-942a-3eb9ab43589d tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:26:12.656579 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.wsgi [None req-e31af29c-57e4-4534-942a-3eb9ab43589d tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] HTTP exception thrown: Instance 160754d3-09be-409f-acb5-7f7acc57bfc1 could not be found. Aug 03 19:26:12.658088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-e31af29c-57e4-4534-942a-3eb9ab43589d tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Request method failure captured: Aug 03 19:26:12.658088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: request: DELETE /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1 HTTP/1.1 Aug 03 19:26:12.658088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept: application/json Aug 03 19:26:12.658088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept-Encoding: identity Aug 03 19:26:12.658088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Connection: close Aug 03 19:26:12.658088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Length: 0 Aug 03 19:26:12.658088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Type: application/json Aug 03 19:26:12.658088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Host: 10.222.0.77 Aug 03 19:26:12.658088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Openstack-System-Scope: None Aug 03 19:26:12.658088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: User-Agent: python-urllib3/1.26.11 Aug 03 19:26:12.658088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Auth-Token: gAAAAABi6soo3tVsyMpp4Q5BeVYgBkb-ZmSXfFqqDLxngfO69yiJ0ybu4b_gQBD6U7zMaZpKagPnF0tkOMv2DMg2Ki8vJ6bAkRfUIOgz6V1xoe8gX_F1YIssVOFX-QTa-WpQkCCkJJtYSX1EJo1Xmv5e_ntC-Qe1WtL2fOzOa0FpdkQ5uZgdkSk Aug 03 19:26:12.658088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Id: None Aug 03 19:26:12.658088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Name: None Aug 03 19:26:12.658088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Identity-Status: Confirmed Aug 03 19:26:12.658088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Is-Admin-Project: True Aug 03 19:26:12.658088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Id: default Aug 03 19:26:12.658088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Name: Default Aug 03 19:26:12.658088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Id: e02e6595d2284de190bb759806ca02f6 Aug 03 19:26:12.658088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Name: tempest-AttachVolumeNegativeTest-1363049785 Aug 03 19:26:12.658088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Role: reader,member Aug 03 19:26:12.658088 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Roles: reader,member Aug 03 19:26:12.659866 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_e02e6595d2284de190bb759806ca02f6", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/e02e6595d2284de190bb759806ca02f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/e02e6595d2284de190bb759806ca02f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/e02e6595d2284de190bb759806ca02f6"}]}] Aug 03 19:26:12.659866 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant: tempest-AttachVolumeNegativeTest-1363049785 Aug 03 19:26:12.659866 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Id: e02e6595d2284de190bb759806ca02f6 Aug 03 19:26:12.659866 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1363049785 Aug 03 19:26:12.659866 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User: tempest-AttachVolumeNegativeTest-1363049785-project Aug 03 19:26:12.659866 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Id: default Aug 03 19:26:12.659866 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Name: Default Aug 03 19:26:12.659866 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Id: 32425eddf65f477db53594f7d4b447e2 Aug 03 19:26:12.659866 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Name: tempest-AttachVolumeNegativeTest-1363049785-project Aug 03 19:26:12.659866 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: method: > Aug 03 19:26:12.659866 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: exception: Instance 160754d3-09be-409f-acb5-7f7acc57bfc1 could not be found. Aug 03 19:26:12.659866 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: action_args: {'id': '160754d3-09be-409f-acb5-7f7acc57bfc1'} Aug 03 19:26:12.660841 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:26:12.660841 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:26:12.660841 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:26:12.660841 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:26:12.660841 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:26:12.660841 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:26:12.660841 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:26:12.660841 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:26:12.660841 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:26:12.660841 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:26:12.660841 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 160754d3-09be-409f-acb5-7f7acc57bfc1 could not be found. Aug 03 19:26:12.660841 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:26:12.660841 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:26:12.660841 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:26:12.660841 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:26:12.660841 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:26:12.660841 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:26:12.660841 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:26:12.660841 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:26:12.660841 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:26:12.662385 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:26:12.662385 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 19:26:12.662385 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 19:26:12.662385 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 19:26:12.662385 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 19:26:12.662385 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:26:12.662385 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:26:12.662385 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:26:12.662385 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:26:12.662385 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 160754d3-09be-409f-acb5-7f7acc57bfc1 could not be found. Aug 03 19:26:12.662385 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:26:12.662385 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:26:12.662385 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:26:12.662385 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:26:12.662385 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:26:12.662385 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:26:12.662385 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:26:12.662385 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:26:12.662385 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 160754d3-09be-409f-acb5-7f7acc57bfc1 could not be found. Aug 03 19:26:12.662385 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:26:12.664009 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-e31af29c-57e4-4534-942a-3eb9ab43589d tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Returning 404 to user: Instance 160754d3-09be-409f-acb5-7f7acc57bfc1 could not be found. {{(pid=118303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:26:12.664009 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-e31af29c-57e4-4534-942a-3eb9ab43589d tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "DELETE /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1" status: 404 len: 111 microversion: 2.1 time: 0.029401 Aug 03 19:26:12.664009 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 520/1037] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 3 19:26:12 2022] DELETE /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:26:12.667907 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-56a59494-2182-47ab-bbe3-14262e2c641d tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:26:12.668530 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-56a59494-2182-47ab-bbe3-14262e2c641d tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 160754d3-09be-409f-acb5-7f7acc57bfc1] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:26:12.675974 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-56a59494-2182-47ab-bbe3-14262e2c641d tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:26:12.676533 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-56a59494-2182-47ab-bbe3-14262e2c641d tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:26:12.677346 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-56a59494-2182-47ab-bbe3-14262e2c641d tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:26:12.677793 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-56a59494-2182-47ab-bbe3-14262e2c641d tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:26:12.692641 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.wsgi [None req-56a59494-2182-47ab-bbe3-14262e2c641d tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] HTTP exception thrown: Instance 160754d3-09be-409f-acb5-7f7acc57bfc1 could not be found. Aug 03 19:26:12.694164 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-56a59494-2182-47ab-bbe3-14262e2c641d tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Request method failure captured: Aug 03 19:26:12.694164 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: request: GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1 HTTP/1.1 Aug 03 19:26:12.694164 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept: application/json Aug 03 19:26:12.694164 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept-Encoding: identity Aug 03 19:26:12.694164 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Connection: close Aug 03 19:26:12.694164 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Length: 0 Aug 03 19:26:12.694164 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Type: application/json Aug 03 19:26:12.694164 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Host: 10.222.0.77 Aug 03 19:26:12.694164 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Openstack-System-Scope: None Aug 03 19:26:12.694164 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: User-Agent: python-urllib3/1.26.11 Aug 03 19:26:12.694164 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Auth-Token: gAAAAABi6soo3tVsyMpp4Q5BeVYgBkb-ZmSXfFqqDLxngfO69yiJ0ybu4b_gQBD6U7zMaZpKagPnF0tkOMv2DMg2Ki8vJ6bAkRfUIOgz6V1xoe8gX_F1YIssVOFX-QTa-WpQkCCkJJtYSX1EJo1Xmv5e_ntC-Qe1WtL2fOzOa0FpdkQ5uZgdkSk Aug 03 19:26:12.694164 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Id: None Aug 03 19:26:12.694164 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Name: None Aug 03 19:26:12.694164 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Identity-Status: Confirmed Aug 03 19:26:12.694164 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Is-Admin-Project: True Aug 03 19:26:12.694164 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Id: default Aug 03 19:26:12.694164 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Name: Default Aug 03 19:26:12.694164 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Id: e02e6595d2284de190bb759806ca02f6 Aug 03 19:26:12.694164 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Name: tempest-AttachVolumeNegativeTest-1363049785 Aug 03 19:26:12.694164 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Role: reader,member Aug 03 19:26:12.694164 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Roles: reader,member Aug 03 19:26:12.695911 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_e02e6595d2284de190bb759806ca02f6", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/e02e6595d2284de190bb759806ca02f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/e02e6595d2284de190bb759806ca02f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/e02e6595d2284de190bb759806ca02f6"}]}] Aug 03 19:26:12.695911 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant: tempest-AttachVolumeNegativeTest-1363049785 Aug 03 19:26:12.695911 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Id: e02e6595d2284de190bb759806ca02f6 Aug 03 19:26:12.695911 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1363049785 Aug 03 19:26:12.695911 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User: tempest-AttachVolumeNegativeTest-1363049785-project Aug 03 19:26:12.695911 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Id: default Aug 03 19:26:12.695911 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Name: Default Aug 03 19:26:12.695911 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Id: 32425eddf65f477db53594f7d4b447e2 Aug 03 19:26:12.695911 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Name: tempest-AttachVolumeNegativeTest-1363049785-project Aug 03 19:26:12.695911 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: method: > Aug 03 19:26:12.695911 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: exception: Instance 160754d3-09be-409f-acb5-7f7acc57bfc1 could not be found. Aug 03 19:26:12.695911 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: action_args: {'id': '160754d3-09be-409f-acb5-7f7acc57bfc1'} Aug 03 19:26:12.696832 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:26:12.696832 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:26:12.696832 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:26:12.696832 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:26:12.696832 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:26:12.696832 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:26:12.696832 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:26:12.696832 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:26:12.696832 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:26:12.696832 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:26:12.696832 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 160754d3-09be-409f-acb5-7f7acc57bfc1 could not be found. Aug 03 19:26:12.696832 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:26:12.696832 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:26:12.696832 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:26:12.696832 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:26:12.696832 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:26:12.696832 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:26:12.696832 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:26:12.696832 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:26:12.696832 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:26:12.698388 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:26:12.698388 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:26:12.698388 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:26:12.698388 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:26:12.698388 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:26:12.698388 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:26:12.698388 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:26:12.698388 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 160754d3-09be-409f-acb5-7f7acc57bfc1 could not be found. Aug 03 19:26:12.698388 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:26:12.698388 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:26:12.698388 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:26:12.698388 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:26:12.698388 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:26:12.698388 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:26:12.698388 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:26:12.698388 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:26:12.698388 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 160754d3-09be-409f-acb5-7f7acc57bfc1 could not be found. Aug 03 19:26:12.698388 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:26:12.699832 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-56a59494-2182-47ab-bbe3-14262e2c641d tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Returning 404 to user: Instance 160754d3-09be-409f-acb5-7f7acc57bfc1 could not be found. {{(pid=118302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:26:12.699832 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-56a59494-2182-47ab-bbe3-14262e2c641d tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1" status: 404 len: 111 microversion: 2.1 time: 0.031727 Aug 03 19:26:12.699832 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 518/1038] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:26:12 2022] GET /compute/v2.1/servers/160754d3-09be-409f-acb5-7f7acc57bfc1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:26:12.704218 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-fce8bf5a-43fa-4bd6-b767-fb53be1864ab tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:26:12.704724 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-fce8bf5a-43fa-4bd6-b767-fb53be1864ab tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 257e78c5-4e3b-4ab7-a406-3260323d6657] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:26:12.711793 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fce8bf5a-43fa-4bd6-b767-fb53be1864ab tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:26:12.712244 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fce8bf5a-43fa-4bd6-b767-fb53be1864ab tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:26:12.713016 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fce8bf5a-43fa-4bd6-b767-fb53be1864ab tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:26:12.713455 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-fce8bf5a-43fa-4bd6-b767-fb53be1864ab tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:26:12.726606 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.wsgi [None req-fce8bf5a-43fa-4bd6-b767-fb53be1864ab tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] HTTP exception thrown: Instance 257e78c5-4e3b-4ab7-a406-3260323d6657 could not be found. Aug 03 19:26:12.728165 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-fce8bf5a-43fa-4bd6-b767-fb53be1864ab tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Request method failure captured: Aug 03 19:26:12.728165 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: request: DELETE /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657 HTTP/1.1 Aug 03 19:26:12.728165 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept: application/json Aug 03 19:26:12.728165 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept-Encoding: identity Aug 03 19:26:12.728165 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Connection: close Aug 03 19:26:12.728165 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Length: 0 Aug 03 19:26:12.728165 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Type: application/json Aug 03 19:26:12.728165 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Host: 10.222.0.77 Aug 03 19:26:12.728165 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Openstack-System-Scope: None Aug 03 19:26:12.728165 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: User-Agent: python-urllib3/1.26.11 Aug 03 19:26:12.728165 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Auth-Token: gAAAAABi6soo3tVsyMpp4Q5BeVYgBkb-ZmSXfFqqDLxngfO69yiJ0ybu4b_gQBD6U7zMaZpKagPnF0tkOMv2DMg2Ki8vJ6bAkRfUIOgz6V1xoe8gX_F1YIssVOFX-QTa-WpQkCCkJJtYSX1EJo1Xmv5e_ntC-Qe1WtL2fOzOa0FpdkQ5uZgdkSk Aug 03 19:26:12.728165 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Id: None Aug 03 19:26:12.728165 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Name: None Aug 03 19:26:12.728165 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Identity-Status: Confirmed Aug 03 19:26:12.728165 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Is-Admin-Project: True Aug 03 19:26:12.728165 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Id: default Aug 03 19:26:12.728165 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Name: Default Aug 03 19:26:12.728165 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Id: e02e6595d2284de190bb759806ca02f6 Aug 03 19:26:12.728165 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Name: tempest-AttachVolumeNegativeTest-1363049785 Aug 03 19:26:12.728165 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Role: reader,member Aug 03 19:26:12.728165 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Roles: reader,member Aug 03 19:26:12.729821 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_e02e6595d2284de190bb759806ca02f6", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/e02e6595d2284de190bb759806ca02f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/e02e6595d2284de190bb759806ca02f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/e02e6595d2284de190bb759806ca02f6"}]}] Aug 03 19:26:12.729821 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant: tempest-AttachVolumeNegativeTest-1363049785 Aug 03 19:26:12.729821 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Id: e02e6595d2284de190bb759806ca02f6 Aug 03 19:26:12.729821 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1363049785 Aug 03 19:26:12.729821 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User: tempest-AttachVolumeNegativeTest-1363049785-project Aug 03 19:26:12.729821 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Id: default Aug 03 19:26:12.729821 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Name: Default Aug 03 19:26:12.729821 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Id: 32425eddf65f477db53594f7d4b447e2 Aug 03 19:26:12.729821 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Name: tempest-AttachVolumeNegativeTest-1363049785-project Aug 03 19:26:12.729821 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: method: > Aug 03 19:26:12.729821 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: exception: Instance 257e78c5-4e3b-4ab7-a406-3260323d6657 could not be found. Aug 03 19:26:12.729821 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: action_args: {'id': '257e78c5-4e3b-4ab7-a406-3260323d6657'} Aug 03 19:26:12.730651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:26:12.730651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:26:12.730651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:26:12.730651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:26:12.730651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:26:12.730651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:26:12.730651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:26:12.730651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:26:12.730651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:26:12.730651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:26:12.730651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 257e78c5-4e3b-4ab7-a406-3260323d6657 could not be found. Aug 03 19:26:12.730651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:26:12.730651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:26:12.730651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:26:12.730651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:26:12.730651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:26:12.730651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:26:12.730651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:26:12.730651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:26:12.730651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:26:12.732185 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:26:12.732185 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 19:26:12.732185 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 19:26:12.732185 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 19:26:12.732185 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 19:26:12.732185 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:26:12.732185 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:26:12.732185 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:26:12.732185 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:26:12.732185 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 257e78c5-4e3b-4ab7-a406-3260323d6657 could not be found. Aug 03 19:26:12.732185 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:26:12.732185 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:26:12.732185 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:26:12.732185 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:26:12.732185 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:26:12.732185 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:26:12.732185 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:26:12.732185 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:26:12.732185 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 257e78c5-4e3b-4ab7-a406-3260323d6657 could not be found. Aug 03 19:26:12.732185 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:26:12.733690 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-fce8bf5a-43fa-4bd6-b767-fb53be1864ab tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Returning 404 to user: Instance 257e78c5-4e3b-4ab7-a406-3260323d6657 could not be found. {{(pid=118303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:26:12.733690 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-fce8bf5a-43fa-4bd6-b767-fb53be1864ab tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "DELETE /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657" status: 404 len: 111 microversion: 2.1 time: 0.029132 Aug 03 19:26:12.733690 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 521/1039] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 3 19:26:12 2022] DELETE /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:26:12.738659 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-df591733-8786-4b38-869f-0a1185f72ad7 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:26:12.739300 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-df591733-8786-4b38-869f-0a1185f72ad7 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 257e78c5-4e3b-4ab7-a406-3260323d6657] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:26:12.745318 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-df591733-8786-4b38-869f-0a1185f72ad7 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:26:12.745798 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-df591733-8786-4b38-869f-0a1185f72ad7 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:26:12.746554 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-df591733-8786-4b38-869f-0a1185f72ad7 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:26:12.747010 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-df591733-8786-4b38-869f-0a1185f72ad7 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:26:12.761241 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.wsgi [None req-df591733-8786-4b38-869f-0a1185f72ad7 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] HTTP exception thrown: Instance 257e78c5-4e3b-4ab7-a406-3260323d6657 could not be found. Aug 03 19:26:12.762709 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-df591733-8786-4b38-869f-0a1185f72ad7 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Request method failure captured: Aug 03 19:26:12.762709 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: request: GET /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657 HTTP/1.1 Aug 03 19:26:12.762709 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept: application/json Aug 03 19:26:12.762709 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept-Encoding: identity Aug 03 19:26:12.762709 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Connection: close Aug 03 19:26:12.762709 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Length: 0 Aug 03 19:26:12.762709 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Type: application/json Aug 03 19:26:12.762709 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Host: 10.222.0.77 Aug 03 19:26:12.762709 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Openstack-System-Scope: None Aug 03 19:26:12.762709 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: User-Agent: python-urllib3/1.26.11 Aug 03 19:26:12.762709 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Auth-Token: gAAAAABi6soo3tVsyMpp4Q5BeVYgBkb-ZmSXfFqqDLxngfO69yiJ0ybu4b_gQBD6U7zMaZpKagPnF0tkOMv2DMg2Ki8vJ6bAkRfUIOgz6V1xoe8gX_F1YIssVOFX-QTa-WpQkCCkJJtYSX1EJo1Xmv5e_ntC-Qe1WtL2fOzOa0FpdkQ5uZgdkSk Aug 03 19:26:12.762709 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Id: None Aug 03 19:26:12.762709 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Name: None Aug 03 19:26:12.762709 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Identity-Status: Confirmed Aug 03 19:26:12.762709 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Is-Admin-Project: True Aug 03 19:26:12.762709 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Id: default Aug 03 19:26:12.762709 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Name: Default Aug 03 19:26:12.762709 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Id: e02e6595d2284de190bb759806ca02f6 Aug 03 19:26:12.762709 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Name: tempest-AttachVolumeNegativeTest-1363049785 Aug 03 19:26:12.762709 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Role: reader,member Aug 03 19:26:12.762709 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Roles: reader,member Aug 03 19:26:12.764388 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_e02e6595d2284de190bb759806ca02f6", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/e02e6595d2284de190bb759806ca02f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/e02e6595d2284de190bb759806ca02f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/e02e6595d2284de190bb759806ca02f6"}]}] Aug 03 19:26:12.764388 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant: tempest-AttachVolumeNegativeTest-1363049785 Aug 03 19:26:12.764388 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Id: e02e6595d2284de190bb759806ca02f6 Aug 03 19:26:12.764388 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1363049785 Aug 03 19:26:12.764388 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User: tempest-AttachVolumeNegativeTest-1363049785-project Aug 03 19:26:12.764388 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Id: default Aug 03 19:26:12.764388 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Name: Default Aug 03 19:26:12.764388 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Id: 32425eddf65f477db53594f7d4b447e2 Aug 03 19:26:12.764388 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Name: tempest-AttachVolumeNegativeTest-1363049785-project Aug 03 19:26:12.764388 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: method: > Aug 03 19:26:12.764388 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: exception: Instance 257e78c5-4e3b-4ab7-a406-3260323d6657 could not be found. Aug 03 19:26:12.764388 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: action_args: {'id': '257e78c5-4e3b-4ab7-a406-3260323d6657'} Aug 03 19:26:12.765205 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:26:12.765205 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:26:12.765205 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:26:12.765205 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:26:12.765205 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:26:12.765205 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:26:12.765205 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:26:12.765205 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:26:12.765205 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:26:12.765205 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:26:12.765205 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 257e78c5-4e3b-4ab7-a406-3260323d6657 could not be found. Aug 03 19:26:12.765205 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:26:12.765205 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:26:12.765205 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:26:12.765205 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:26:12.765205 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:26:12.765205 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:26:12.765205 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:26:12.765205 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:26:12.765205 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:26:12.766600 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:26:12.766600 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:26:12.766600 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:26:12.766600 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:26:12.766600 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:26:12.766600 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:26:12.766600 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:26:12.766600 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 257e78c5-4e3b-4ab7-a406-3260323d6657 could not be found. Aug 03 19:26:12.766600 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:26:12.766600 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:26:12.766600 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:26:12.766600 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:26:12.766600 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:26:12.766600 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:26:12.766600 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:26:12.766600 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:26:12.766600 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 257e78c5-4e3b-4ab7-a406-3260323d6657 could not be found. Aug 03 19:26:12.766600 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:26:12.767812 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-df591733-8786-4b38-869f-0a1185f72ad7 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Returning 404 to user: Instance 257e78c5-4e3b-4ab7-a406-3260323d6657 could not be found. {{(pid=118302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:26:12.767812 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-df591733-8786-4b38-869f-0a1185f72ad7 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657" status: 404 len: 111 microversion: 2.1 time: 0.029859 Aug 03 19:26:12.767812 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 519/1040] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:26:12 2022] GET /compute/v2.1/servers/257e78c5-4e3b-4ab7-a406-3260323d6657 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 19:26:14.037829 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-f2e682af-3ee3-438f-8d37-fd690d15df50 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:26:14.038321 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-f2e682af-3ee3-438f-8d37-fd690d15df50 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 935a7612-a68e-4af7-a688-c94efb1f2676] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:26:14.044803 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f2e682af-3ee3-438f-8d37-fd690d15df50 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:26:14.045252 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f2e682af-3ee3-438f-8d37-fd690d15df50 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:26:14.046057 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f2e682af-3ee3-438f-8d37-fd690d15df50 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:26:14.046548 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f2e682af-3ee3-438f-8d37-fd690d15df50 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:26:14.059971 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.wsgi [None req-f2e682af-3ee3-438f-8d37-fd690d15df50 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] HTTP exception thrown: Instance 935a7612-a68e-4af7-a688-c94efb1f2676 could not be found. Aug 03 19:26:14.061488 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-f2e682af-3ee3-438f-8d37-fd690d15df50 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Request method failure captured: Aug 03 19:26:14.061488 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: request: DELETE /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676 HTTP/1.1 Aug 03 19:26:14.061488 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept: application/json Aug 03 19:26:14.061488 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept-Encoding: identity Aug 03 19:26:14.061488 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Connection: close Aug 03 19:26:14.061488 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Length: 0 Aug 03 19:26:14.061488 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Type: application/json Aug 03 19:26:14.061488 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Host: 10.222.0.77 Aug 03 19:26:14.061488 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Openstack-System-Scope: None Aug 03 19:26:14.061488 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: User-Agent: python-urllib3/1.26.11 Aug 03 19:26:14.061488 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Auth-Token: gAAAAABi6soo3tVsyMpp4Q5BeVYgBkb-ZmSXfFqqDLxngfO69yiJ0ybu4b_gQBD6U7zMaZpKagPnF0tkOMv2DMg2Ki8vJ6bAkRfUIOgz6V1xoe8gX_F1YIssVOFX-QTa-WpQkCCkJJtYSX1EJo1Xmv5e_ntC-Qe1WtL2fOzOa0FpdkQ5uZgdkSk Aug 03 19:26:14.061488 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Id: None Aug 03 19:26:14.061488 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Name: None Aug 03 19:26:14.061488 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Identity-Status: Confirmed Aug 03 19:26:14.061488 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Is-Admin-Project: True Aug 03 19:26:14.061488 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Id: default Aug 03 19:26:14.061488 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Name: Default Aug 03 19:26:14.061488 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Id: e02e6595d2284de190bb759806ca02f6 Aug 03 19:26:14.061488 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Name: tempest-AttachVolumeNegativeTest-1363049785 Aug 03 19:26:14.061488 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Role: reader,member Aug 03 19:26:14.061488 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Roles: reader,member Aug 03 19:26:14.063155 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_e02e6595d2284de190bb759806ca02f6", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/e02e6595d2284de190bb759806ca02f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/e02e6595d2284de190bb759806ca02f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/e02e6595d2284de190bb759806ca02f6"}]}] Aug 03 19:26:14.063155 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant: tempest-AttachVolumeNegativeTest-1363049785 Aug 03 19:26:14.063155 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Id: e02e6595d2284de190bb759806ca02f6 Aug 03 19:26:14.063155 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1363049785 Aug 03 19:26:14.063155 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User: tempest-AttachVolumeNegativeTest-1363049785-project Aug 03 19:26:14.063155 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Id: default Aug 03 19:26:14.063155 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Name: Default Aug 03 19:26:14.063155 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Id: 32425eddf65f477db53594f7d4b447e2 Aug 03 19:26:14.063155 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Name: tempest-AttachVolumeNegativeTest-1363049785-project Aug 03 19:26:14.063155 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: method: > Aug 03 19:26:14.063155 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: exception: Instance 935a7612-a68e-4af7-a688-c94efb1f2676 could not be found. Aug 03 19:26:14.063155 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: action_args: {'id': '935a7612-a68e-4af7-a688-c94efb1f2676'} Aug 03 19:26:14.064476 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:26:14.064476 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:26:14.064476 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:26:14.064476 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:26:14.064476 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:26:14.064476 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:26:14.064476 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:26:14.064476 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:26:14.064476 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:26:14.064476 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:26:14.064476 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 935a7612-a68e-4af7-a688-c94efb1f2676 could not be found. Aug 03 19:26:14.064476 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:26:14.064476 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:26:14.064476 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:26:14.064476 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:26:14.064476 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:26:14.064476 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:26:14.064476 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:26:14.064476 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:26:14.064476 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:26:14.066674 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:26:14.066674 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 19:26:14.066674 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 19:26:14.066674 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 19:26:14.066674 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 19:26:14.066674 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:26:14.066674 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:26:14.066674 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:26:14.066674 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:26:14.066674 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 935a7612-a68e-4af7-a688-c94efb1f2676 could not be found. Aug 03 19:26:14.066674 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:26:14.066674 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:26:14.066674 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:26:14.066674 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:26:14.066674 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:26:14.066674 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:26:14.066674 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:26:14.066674 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:26:14.066674 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 935a7612-a68e-4af7-a688-c94efb1f2676 could not be found. Aug 03 19:26:14.066674 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:26:14.068641 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-f2e682af-3ee3-438f-8d37-fd690d15df50 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Returning 404 to user: Instance 935a7612-a68e-4af7-a688-c94efb1f2676 could not be found. {{(pid=118303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:26:14.068641 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-f2e682af-3ee3-438f-8d37-fd690d15df50 tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "DELETE /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676" status: 404 len: 111 microversion: 2.1 time: 0.028965 Aug 03 19:26:14.068641 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 522/1041] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 3 19:26:14 2022] DELETE /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:26:14.072141 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-0b964414-e283-4cf0-8c93-b24dc547a10f tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:26:14.072761 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-0b964414-e283-4cf0-8c93-b24dc547a10f tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] [instance: 935a7612-a68e-4af7-a688-c94efb1f2676] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:26:14.079385 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0b964414-e283-4cf0-8c93-b24dc547a10f tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:26:14.079846 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0b964414-e283-4cf0-8c93-b24dc547a10f tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:26:14.080622 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0b964414-e283-4cf0-8c93-b24dc547a10f tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:26:14.081069 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-0b964414-e283-4cf0-8c93-b24dc547a10f tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:26:14.095196 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.wsgi [None req-0b964414-e283-4cf0-8c93-b24dc547a10f tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] HTTP exception thrown: Instance 935a7612-a68e-4af7-a688-c94efb1f2676 could not be found. Aug 03 19:26:14.096629 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-0b964414-e283-4cf0-8c93-b24dc547a10f tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Request method failure captured: Aug 03 19:26:14.096629 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: request: GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676 HTTP/1.1 Aug 03 19:26:14.096629 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept: application/json Aug 03 19:26:14.096629 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept-Encoding: identity Aug 03 19:26:14.096629 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Connection: close Aug 03 19:26:14.096629 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Length: 0 Aug 03 19:26:14.096629 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Type: application/json Aug 03 19:26:14.096629 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Host: 10.222.0.77 Aug 03 19:26:14.096629 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Openstack-System-Scope: None Aug 03 19:26:14.096629 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: User-Agent: python-urllib3/1.26.11 Aug 03 19:26:14.096629 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Auth-Token: gAAAAABi6soo3tVsyMpp4Q5BeVYgBkb-ZmSXfFqqDLxngfO69yiJ0ybu4b_gQBD6U7zMaZpKagPnF0tkOMv2DMg2Ki8vJ6bAkRfUIOgz6V1xoe8gX_F1YIssVOFX-QTa-WpQkCCkJJtYSX1EJo1Xmv5e_ntC-Qe1WtL2fOzOa0FpdkQ5uZgdkSk Aug 03 19:26:14.096629 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Id: None Aug 03 19:26:14.096629 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Name: None Aug 03 19:26:14.096629 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Identity-Status: Confirmed Aug 03 19:26:14.096629 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Is-Admin-Project: True Aug 03 19:26:14.096629 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Id: default Aug 03 19:26:14.096629 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Name: Default Aug 03 19:26:14.096629 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Id: e02e6595d2284de190bb759806ca02f6 Aug 03 19:26:14.096629 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Name: tempest-AttachVolumeNegativeTest-1363049785 Aug 03 19:26:14.096629 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Role: reader,member Aug 03 19:26:14.096629 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Roles: reader,member Aug 03 19:26:14.098668 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_e02e6595d2284de190bb759806ca02f6", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/e02e6595d2284de190bb759806ca02f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/e02e6595d2284de190bb759806ca02f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/e02e6595d2284de190bb759806ca02f6"}]}] Aug 03 19:26:14.098668 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant: tempest-AttachVolumeNegativeTest-1363049785 Aug 03 19:26:14.098668 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Id: e02e6595d2284de190bb759806ca02f6 Aug 03 19:26:14.098668 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1363049785 Aug 03 19:26:14.098668 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User: tempest-AttachVolumeNegativeTest-1363049785-project Aug 03 19:26:14.098668 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Id: default Aug 03 19:26:14.098668 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Name: Default Aug 03 19:26:14.098668 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Id: 32425eddf65f477db53594f7d4b447e2 Aug 03 19:26:14.098668 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Name: tempest-AttachVolumeNegativeTest-1363049785-project Aug 03 19:26:14.098668 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: method: > Aug 03 19:26:14.098668 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: exception: Instance 935a7612-a68e-4af7-a688-c94efb1f2676 could not be found. Aug 03 19:26:14.098668 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: action_args: {'id': '935a7612-a68e-4af7-a688-c94efb1f2676'} Aug 03 19:26:14.099653 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:26:14.099653 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:26:14.099653 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:26:14.099653 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:26:14.099653 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:26:14.099653 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:26:14.099653 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:26:14.099653 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:26:14.099653 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:26:14.099653 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:26:14.099653 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 935a7612-a68e-4af7-a688-c94efb1f2676 could not be found. Aug 03 19:26:14.099653 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:26:14.099653 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:26:14.099653 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:26:14.099653 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:26:14.099653 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:26:14.099653 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:26:14.099653 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:26:14.099653 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:26:14.099653 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:26:14.101254 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:26:14.101254 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:26:14.101254 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:26:14.101254 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:26:14.101254 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:26:14.101254 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:26:14.101254 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:26:14.101254 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 935a7612-a68e-4af7-a688-c94efb1f2676 could not be found. Aug 03 19:26:14.101254 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:26:14.101254 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:26:14.101254 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:26:14.101254 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:26:14.101254 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:26:14.101254 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:26:14.101254 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:26:14.101254 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:26:14.101254 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 935a7612-a68e-4af7-a688-c94efb1f2676 could not be found. Aug 03 19:26:14.101254 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:26:14.102608 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-0b964414-e283-4cf0-8c93-b24dc547a10f tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] Returning 404 to user: Instance 935a7612-a68e-4af7-a688-c94efb1f2676 could not be found. {{(pid=118302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:26:14.102608 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-0b964414-e283-4cf0-8c93-b24dc547a10f tempest-AttachVolumeNegativeTest-1363049785 tempest-AttachVolumeNegativeTest-1363049785-project] 10.222.0.77 "GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676" status: 404 len: 111 microversion: 2.1 time: 0.029691 Aug 03 19:26:14.102608 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 520/1042] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:26:14 2022] GET /compute/v2.1/servers/935a7612-a68e-4af7-a688-c94efb1f2676 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:26:30.335174 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 03 19:26:30.335856 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Wed Aug 3 19:26:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 19:27:37.323445 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:27:37.324243 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:27:37.328215 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-412bd5bb-c2f5-42e1-a5cf-ddd239d7bfd7 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-358805916", "imageRef": "0b6be242-215e-4886-a0d2-b8d5f8ca623e", "flavorRef": "452", "networks": [{"uuid": "69831f20-12da-4198-83ad-b445946b05ea"}]}} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:27:37.388350 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.network.neutron [None req-412bd5bb-c2f5-42e1-a5cf-ddd239d7bfd7 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] validate_networks() for [('69831f20-12da-4198-83ad-b445946b05ea', None, None, None, None, None)] {{(pid=118303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 19:27:37.736688 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-412bd5bb-c2f5-42e1-a5cf-ddd239d7bfd7 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Flavor limits 0:0:0 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 19:27:37.737108 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-412bd5bb-c2f5-42e1-a5cf-ddd239d7bfd7 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Image limits 0:0:0 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 19:27:37.738494 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-412bd5bb-c2f5-42e1-a5cf-ddd239d7bfd7 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Flavor pref 0:0:0 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 19:27:37.738494 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-412bd5bb-c2f5-42e1-a5cf-ddd239d7bfd7 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Image pref 0:0:0 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 19:27:37.738762 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-412bd5bb-c2f5-42e1-a5cf-ddd239d7bfd7 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 19:27:37.747554 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-412bd5bb-c2f5-42e1-a5cf-ddd239d7bfd7 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:27:37.748051 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-412bd5bb-c2f5-42e1-a5cf-ddd239d7bfd7 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:27:37.748798 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-412bd5bb-c2f5-42e1-a5cf-ddd239d7bfd7 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:27:37.749238 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-412bd5bb-c2f5-42e1-a5cf-ddd239d7bfd7 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:27:37.766096 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.quota [None req-412bd5bb-c2f5-42e1-a5cf-ddd239d7bfd7 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Getting quotas for project 37f9946496484a0b8d616790bbdec62f. Resources: {'instances', 'cores', 'ram'} {{(pid=118303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:27:37.770823 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.quota [None req-412bd5bb-c2f5-42e1-a5cf-ddd239d7bfd7 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Getting quotas for user 4cda314ac5eb4e57aee4dd59b7a407ec and project 37f9946496484a0b8d616790bbdec62f. Resources: {'instances', 'cores', 'ram'} {{(pid=118303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:27:37.782545 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-412bd5bb-c2f5-42e1-a5cf-ddd239d7bfd7 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Going to run 1 instances... {{(pid=118303) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 19:27:37.785529 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-412bd5bb-c2f5-42e1-a5cf-ddd239d7bfd7 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: 4ca38833-19b9-4c96-b4f1-f1e81f1839d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0b6be242-215e-4886-a0d2-b8d5f8ca623e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 19:27:37.929278 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-412bd5bb-c2f5-42e1-a5cf-ddd239d7bfd7 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.607417 Aug 03 19:27:37.929922 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 523/1043] 10.222.0.77 () {60 vars in 1147 bytes} [Wed Aug 3 19:27:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 19:27:37.938482 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:27:37.939257 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:27:37.943357 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-5e9ed575-eabf-4a4f-aa76-7bfa9b252a20 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:27:37.947388 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-5e9ed575-eabf-4a4f-aa76-7bfa9b252a20 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: 4ca38833-19b9-4c96-b4f1-f1e81f1839d4] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:27:37.997802 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-5e9ed575-eabf-4a4f-aa76-7bfa9b252a20 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cda314ac5eb4e57aee4dd59b7a407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9946496484a0b8d616790bbdec62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:27:38.005070 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-5e9ed575-eabf-4a4f-aa76-7bfa9b252a20 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "GET /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4" status: 200 len: 1218 microversion: 2.1 time: 0.068315 Aug 03 19:27:38.005749 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 521/1044] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:27:37 2022] GET /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:27:39.024835 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-6b18e19d-6e98-41ed-9e8c-95f886dc4478 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:27:39.025448 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-6b18e19d-6e98-41ed-9e8c-95f886dc4478 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: 4ca38833-19b9-4c96-b4f1-f1e81f1839d4] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:27:39.083204 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-6b18e19d-6e98-41ed-9e8c-95f886dc4478 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cda314ac5eb4e57aee4dd59b7a407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9946496484a0b8d616790bbdec62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:27:39.089968 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-6b18e19d-6e98-41ed-9e8c-95f886dc4478 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "GET /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4" status: 200 len: 1218 microversion: 2.1 time: 0.069077 Aug 03 19:27:39.090525 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 524/1045] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:27:39 2022] GET /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4 => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:27:40.112123 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-def9e14f-0429-425a-97db-129306af953d tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:27:40.112729 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-def9e14f-0429-425a-97db-129306af953d tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: 4ca38833-19b9-4c96-b4f1-f1e81f1839d4] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:27:40.173309 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-def9e14f-0429-425a-97db-129306af953d tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cda314ac5eb4e57aee4dd59b7a407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9946496484a0b8d616790bbdec62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:27:40.180037 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-def9e14f-0429-425a-97db-129306af953d tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "GET /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4" status: 200 len: 1218 microversion: 2.1 time: 0.072411 Aug 03 19:27:40.180889 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 522/1046] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:27:40 2022] GET /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4 => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:27:41.201611 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-6283d25b-0265-4004-a9f0-7d105db457dd tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:27:41.202224 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-6283d25b-0265-4004-a9f0-7d105db457dd tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: 4ca38833-19b9-4c96-b4f1-f1e81f1839d4] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:27:41.256030 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-6283d25b-0265-4004-a9f0-7d105db457dd tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cda314ac5eb4e57aee4dd59b7a407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9946496484a0b8d616790bbdec62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:27:41.262905 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-6283d25b-0265-4004-a9f0-7d105db457dd tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "GET /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4" status: 200 len: 1218 microversion: 2.1 time: 0.065248 Aug 03 19:27:41.263483 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 525/1047] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:27:41 2022] GET /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4 => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:27:42.284398 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-23fa3184-d9d7-4164-9168-7ba99d395140 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:27:42.285744 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-23fa3184-d9d7-4164-9168-7ba99d395140 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: 4ca38833-19b9-4c96-b4f1-f1e81f1839d4] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:27:42.292827 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-23fa3184-d9d7-4164-9168-7ba99d395140 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:27:42.293282 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-23fa3184-d9d7-4164-9168-7ba99d395140 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:27:42.294056 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-23fa3184-d9d7-4164-9168-7ba99d395140 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:27:42.294494 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-23fa3184-d9d7-4164-9168-7ba99d395140 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:27:42.359599 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-23fa3184-d9d7-4164-9168-7ba99d395140 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cda314ac5eb4e57aee4dd59b7a407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9946496484a0b8d616790bbdec62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:27:42.367255 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-23fa3184-d9d7-4164-9168-7ba99d395140 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "GET /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4" status: 200 len: 1222 microversion: 2.1 time: 0.087074 Aug 03 19:27:42.367814 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 523/1048] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:27:42 2022] GET /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4 => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:27:43.387719 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-cf8df323-ac79-4791-85be-fc1805a1bae3 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:27:43.388335 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-cf8df323-ac79-4791-85be-fc1805a1bae3 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: 4ca38833-19b9-4c96-b4f1-f1e81f1839d4] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:27:43.395479 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cf8df323-ac79-4791-85be-fc1805a1bae3 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:27:43.395934 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cf8df323-ac79-4791-85be-fc1805a1bae3 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:27:43.396707 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cf8df323-ac79-4791-85be-fc1805a1bae3 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:27:43.397147 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cf8df323-ac79-4791-85be-fc1805a1bae3 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:27:43.460465 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-cf8df323-ac79-4791-85be-fc1805a1bae3 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cda314ac5eb4e57aee4dd59b7a407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9946496484a0b8d616790bbdec62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:27:43.468063 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-cf8df323-ac79-4791-85be-fc1805a1bae3 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "GET /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4" status: 200 len: 1214 microversion: 2.1 time: 0.084325 Aug 03 19:27:43.468623 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 526/1049] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:27:43 2022] GET /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:27:44.491232 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-18480e03-645d-4f20-9c35-c3d8502a1631 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:27:44.491787 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-18480e03-645d-4f20-9c35-c3d8502a1631 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: 4ca38833-19b9-4c96-b4f1-f1e81f1839d4] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:27:44.498292 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-18480e03-645d-4f20-9c35-c3d8502a1631 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:27:44.498747 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-18480e03-645d-4f20-9c35-c3d8502a1631 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:27:44.499567 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-18480e03-645d-4f20-9c35-c3d8502a1631 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:27:44.500010 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-18480e03-645d-4f20-9c35-c3d8502a1631 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:27:44.566976 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-18480e03-645d-4f20-9c35-c3d8502a1631 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cda314ac5eb4e57aee4dd59b7a407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9946496484a0b8d616790bbdec62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:27:44.576090 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-18480e03-645d-4f20-9c35-c3d8502a1631 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "GET /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4" status: 200 len: 1288 microversion: 2.1 time: 0.089476 Aug 03 19:27:44.583228 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 524/1050] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:27:44 2022] GET /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4 => generated 1288 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:27:45.600641 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-21673c0b-bf1e-426a-8fdd-96d7b8c08eb5 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:27:45.601257 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-21673c0b-bf1e-426a-8fdd-96d7b8c08eb5 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: 4ca38833-19b9-4c96-b4f1-f1e81f1839d4] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:27:45.607894 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-21673c0b-bf1e-426a-8fdd-96d7b8c08eb5 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:27:45.608348 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-21673c0b-bf1e-426a-8fdd-96d7b8c08eb5 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:27:45.609130 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-21673c0b-bf1e-426a-8fdd-96d7b8c08eb5 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:27:45.609553 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-21673c0b-bf1e-426a-8fdd-96d7b8c08eb5 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:27:45.741263 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-21673c0b-bf1e-426a-8fdd-96d7b8c08eb5 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cda314ac5eb4e57aee4dd59b7a407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9946496484a0b8d616790bbdec62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:27:45.748689 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-21673c0b-bf1e-426a-8fdd-96d7b8c08eb5 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "GET /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4" status: 200 len: 1318 microversion: 2.1 time: 0.152136 Aug 03 19:27:45.749239 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 527/1051] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:27:45 2022] GET /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:27:46.078647 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-c56a069c-4a1d-4ff2-b861-c99da1087d7e req-64ab22b9-ea32-445f-8927-6dd75005d3b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ca38833-19b9-4c96-b4f1-f1e81f1839d4", "tag": "6fb8bf05-9eb1-4d06-ad46-405e26edfe25"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:27:46.088443 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-c56a069c-4a1d-4ff2-b861-c99da1087d7e req-64ab22b9-ea32-445f-8927-6dd75005d3b4 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:27:46.088888 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-c56a069c-4a1d-4ff2-b861-c99da1087d7e req-64ab22b9-ea32-445f-8927-6dd75005d3b4 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:27:46.100121 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-c56a069c-4a1d-4ff2-b861-c99da1087d7e req-64ab22b9-ea32-445f-8927-6dd75005d3b4 service nova] Creating event network-changed:6fb8bf05-9eb1-4d06-ad46-405e26edfe25 for instance 4ca38833-19b9-4c96-b4f1-f1e81f1839d4 on hv-cinder-85202 Aug 03 19:27:46.105646 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-c56a069c-4a1d-4ff2-b861-c99da1087d7e req-64ab22b9-ea32-445f-8927-6dd75005d3b4 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031646 Aug 03 19:27:46.106427 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 525/1052] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:27:46.774167 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-bc31b610-35d8-4bc1-92ce-fc21f53920ff tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:27:46.774786 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-bc31b610-35d8-4bc1-92ce-fc21f53920ff tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: 4ca38833-19b9-4c96-b4f1-f1e81f1839d4] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:27:46.781018 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-bc31b610-35d8-4bc1-92ce-fc21f53920ff tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:27:46.781478 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-bc31b610-35d8-4bc1-92ce-fc21f53920ff tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:27:46.782248 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-bc31b610-35d8-4bc1-92ce-fc21f53920ff tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:27:46.782686 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-bc31b610-35d8-4bc1-92ce-fc21f53920ff tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:27:46.917323 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-bc31b610-35d8-4bc1-92ce-fc21f53920ff tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cda314ac5eb4e57aee4dd59b7a407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9946496484a0b8d616790bbdec62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:27:46.924888 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-bc31b610-35d8-4bc1-92ce-fc21f53920ff tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "GET /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4" status: 200 len: 1318 microversion: 2.1 time: 0.155134 Aug 03 19:27:46.925469 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 528/1053] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:27:46 2022] GET /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:27:47.946232 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-ba632704-cc58-4d67-91c9-716c83b412e7 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:27:47.946937 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-ba632704-cc58-4d67-91c9-716c83b412e7 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: 4ca38833-19b9-4c96-b4f1-f1e81f1839d4] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:27:47.953805 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ba632704-cc58-4d67-91c9-716c83b412e7 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:27:47.954256 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ba632704-cc58-4d67-91c9-716c83b412e7 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:27:47.955048 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ba632704-cc58-4d67-91c9-716c83b412e7 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:27:47.955495 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ba632704-cc58-4d67-91c9-716c83b412e7 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:27:48.091303 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-ba632704-cc58-4d67-91c9-716c83b412e7 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cda314ac5eb4e57aee4dd59b7a407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9946496484a0b8d616790bbdec62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:27:48.099500 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-ba632704-cc58-4d67-91c9-716c83b412e7 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "GET /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4" status: 200 len: 1318 microversion: 2.1 time: 0.158238 Aug 03 19:27:48.100064 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 526/1054] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:27:47 2022] GET /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:27:49.119883 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-2ba10d92-9589-40fc-8b1e-1e9d63f3ea5f tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:27:49.120497 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-2ba10d92-9589-40fc-8b1e-1e9d63f3ea5f tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: 4ca38833-19b9-4c96-b4f1-f1e81f1839d4] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:27:49.122336 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell0:SELECT=2 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:27:49.127683 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2ba10d92-9589-40fc-8b1e-1e9d63f3ea5f tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:27:49.128137 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2ba10d92-9589-40fc-8b1e-1e9d63f3ea5f tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:27:49.128927 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2ba10d92-9589-40fc-8b1e-1e9d63f3ea5f tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:27:49.133292 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-2ba10d92-9589-40fc-8b1e-1e9d63f3ea5f tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:27:49.258851 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-2ba10d92-9589-40fc-8b1e-1e9d63f3ea5f tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cda314ac5eb4e57aee4dd59b7a407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9946496484a0b8d616790bbdec62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:27:49.266199 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-2ba10d92-9589-40fc-8b1e-1e9d63f3ea5f tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "GET /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4" status: 200 len: 1318 microversion: 2.1 time: 0.150183 Aug 03 19:27:49.266749 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 529/1055] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:27:49 2022] GET /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:27:50.287492 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-8503f131-7715-4472-aa11-d6ad67b6a526 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:27:50.288102 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-8503f131-7715-4472-aa11-d6ad67b6a526 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: 4ca38833-19b9-4c96-b4f1-f1e81f1839d4] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:27:50.291768 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell0:SELECT=4 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:27:50.295259 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8503f131-7715-4472-aa11-d6ad67b6a526 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:27:50.295709 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8503f131-7715-4472-aa11-d6ad67b6a526 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:27:50.296478 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8503f131-7715-4472-aa11-d6ad67b6a526 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:27:50.296912 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8503f131-7715-4472-aa11-d6ad67b6a526 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:27:50.431980 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-8503f131-7715-4472-aa11-d6ad67b6a526 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cda314ac5eb4e57aee4dd59b7a407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9946496484a0b8d616790bbdec62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:27:50.439577 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-8503f131-7715-4472-aa11-d6ad67b6a526 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "GET /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4" status: 200 len: 1318 microversion: 2.1 time: 0.156241 Aug 03 19:27:50.440158 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 527/1056] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:27:50 2022] GET /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:27:51.461756 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-77fabe5d-9fc7-497e-b75c-67e49fcb9ed3 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:27:51.462399 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-77fabe5d-9fc7-497e-b75c-67e49fcb9ed3 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: 4ca38833-19b9-4c96-b4f1-f1e81f1839d4] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:27:51.464705 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell0:SELECT=10 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:27:51.469598 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-77fabe5d-9fc7-497e-b75c-67e49fcb9ed3 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:27:51.470053 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-77fabe5d-9fc7-497e-b75c-67e49fcb9ed3 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:27:51.470822 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-77fabe5d-9fc7-497e-b75c-67e49fcb9ed3 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:27:51.471301 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-77fabe5d-9fc7-497e-b75c-67e49fcb9ed3 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:27:51.601306 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-77fabe5d-9fc7-497e-b75c-67e49fcb9ed3 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cda314ac5eb4e57aee4dd59b7a407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9946496484a0b8d616790bbdec62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:27:51.608775 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-77fabe5d-9fc7-497e-b75c-67e49fcb9ed3 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "GET /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4" status: 200 len: 1318 microversion: 2.1 time: 0.151444 Aug 03 19:27:51.609331 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 530/1057] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:27:51 2022] GET /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:27:52.558285 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-fafbe5fe-27d7-4bb1-a6ea-d78641044c21 req-45209022-4933-43bb-95f1-1579b64c847b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ca38833-19b9-4c96-b4f1-f1e81f1839d4", "name": "network-vif-plugged", "status": "completed", "tag": "6fb8bf05-9eb1-4d06-ad46-405e26edfe25"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:27:52.568339 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-fafbe5fe-27d7-4bb1-a6ea-d78641044c21 req-45209022-4933-43bb-95f1-1579b64c847b service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:27:52.568822 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-fafbe5fe-27d7-4bb1-a6ea-d78641044c21 req-45209022-4933-43bb-95f1-1579b64c847b service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:27:52.580157 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-fafbe5fe-27d7-4bb1-a6ea-d78641044c21 req-45209022-4933-43bb-95f1-1579b64c847b service nova] Creating event network-vif-plugged:6fb8bf05-9eb1-4d06-ad46-405e26edfe25 for instance 4ca38833-19b9-4c96-b4f1-f1e81f1839d4 on hv-cinder-85202 Aug 03 19:27:52.585930 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-fafbe5fe-27d7-4bb1-a6ea-d78641044c21 req-45209022-4933-43bb-95f1-1579b64c847b service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154119 Aug 03 19:27:52.586563 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 528/1058] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:27:52.629237 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-6d03082e-13db-4d6e-ab23-2569ec8a78ff tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:27:52.630003 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-6d03082e-13db-4d6e-ab23-2569ec8a78ff tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: 4ca38833-19b9-4c96-b4f1-f1e81f1839d4] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:27:52.636695 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6d03082e-13db-4d6e-ab23-2569ec8a78ff tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:27:52.637150 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6d03082e-13db-4d6e-ab23-2569ec8a78ff tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:27:52.637922 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6d03082e-13db-4d6e-ab23-2569ec8a78ff tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:27:52.638364 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-6d03082e-13db-4d6e-ab23-2569ec8a78ff tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:27:52.768617 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-6d03082e-13db-4d6e-ab23-2569ec8a78ff tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cda314ac5eb4e57aee4dd59b7a407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9946496484a0b8d616790bbdec62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:27:52.777319 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-6d03082e-13db-4d6e-ab23-2569ec8a78ff tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "GET /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4" status: 200 len: 1318 microversion: 2.1 time: 0.151888 Aug 03 19:27:52.777890 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 531/1059] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:27:52 2022] GET /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:27:53.799398 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-64ea95e0-a104-4404-8e99-bd12553c7298 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:27:53.800136 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-64ea95e0-a104-4404-8e99-bd12553c7298 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: 4ca38833-19b9-4c96-b4f1-f1e81f1839d4] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:27:53.808113 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-64ea95e0-a104-4404-8e99-bd12553c7298 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:27:53.808567 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-64ea95e0-a104-4404-8e99-bd12553c7298 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:27:53.809697 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-64ea95e0-a104-4404-8e99-bd12553c7298 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:27:53.810139 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-64ea95e0-a104-4404-8e99-bd12553c7298 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:27:53.944417 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-64ea95e0-a104-4404-8e99-bd12553c7298 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cda314ac5eb4e57aee4dd59b7a407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9946496484a0b8d616790bbdec62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:27:53.952086 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-64ea95e0-a104-4404-8e99-bd12553c7298 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "GET /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4" status: 200 len: 1318 microversion: 2.1 time: 0.157350 Aug 03 19:27:53.952649 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 529/1060] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:27:53 2022] GET /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:27:54.972635 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-7ba4a41d-36e2-4966-abe5-450634aff9b1 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:27:54.973181 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-7ba4a41d-36e2-4966-abe5-450634aff9b1 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: 4ca38833-19b9-4c96-b4f1-f1e81f1839d4] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:27:54.979887 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-7ba4a41d-36e2-4966-abe5-450634aff9b1 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:27:54.980352 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-7ba4a41d-36e2-4966-abe5-450634aff9b1 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:27:54.981121 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-7ba4a41d-36e2-4966-abe5-450634aff9b1 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:27:54.981564 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-7ba4a41d-36e2-4966-abe5-450634aff9b1 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:27:55.110542 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-7ba4a41d-36e2-4966-abe5-450634aff9b1 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cda314ac5eb4e57aee4dd59b7a407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9946496484a0b8d616790bbdec62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:27:55.119666 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-7ba4a41d-36e2-4966-abe5-450634aff9b1 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "GET /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4" status: 200 len: 1507 microversion: 2.1 time: 0.151114 Aug 03 19:27:55.120227 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 532/1061] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:27:54 2022] GET /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:28:08.204219 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 19:28:08.210360 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Wed Aug 3 19:28:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 19:28:17.975621 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-c0eae739-5fe4-4b18-8651-ecfd64db0fa5 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd53aa34-d460-4127-8973-f655de73c9cb", "device": "/dev/sdb"}} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:28:17.978529 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-c0eae739-5fe4-4b18-8651-ecfd64db0fa5 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: 4ca38833-19b9-4c96-b4f1-f1e81f1839d4] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:28:17.981613 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_api:SELECT=22 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:28:17.982274 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=34 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:28:17.987151 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c0eae739-5fe4-4b18-8651-ecfd64db0fa5 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:28:17.987606 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c0eae739-5fe4-4b18-8651-ecfd64db0fa5 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:28:17.995308 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c0eae739-5fe4-4b18-8651-ecfd64db0fa5 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:28:17.995308 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c0eae739-5fe4-4b18-8651-ecfd64db0fa5 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:28:18.771620 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-c0eae739-5fe4-4b18-8651-ecfd64db0fa5 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "POST /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.799943 Aug 03 19:28:18.772222 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 530/1062] 10.222.0.77 () {60 vars in 1323 bytes} [Wed Aug 3 19:28:17 2022] POST /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4/os-volume_attachments => generated 194 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:28:40.148601 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 19:28:40.149135 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Wed Aug 3 19:28:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 19:28:46.530626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-d8206ab8-078a-4986-affe-ad1fe22b271c tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:28:46.531242 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-d8206ab8-078a-4986-affe-ad1fe22b271c tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: 4ca38833-19b9-4c96-b4f1-f1e81f1839d4] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:28:46.534294 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:28:46.534986 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=44 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:28:46.539727 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d8206ab8-078a-4986-affe-ad1fe22b271c tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:28:46.540174 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d8206ab8-078a-4986-affe-ad1fe22b271c tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:28:46.540929 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d8206ab8-078a-4986-affe-ad1fe22b271c tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:28:46.541361 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d8206ab8-078a-4986-affe-ad1fe22b271c tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:28:46.627973 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.objects.instance [None req-d8206ab8-078a-4986-affe-ad1fe22b271c tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lazy-loading 'services' on Instance uuid 4ca38833-19b9-4c96-b4f1-f1e81f1839d4 {{(pid=118303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:28:46.826821 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-d8206ab8-078a-4986-affe-ad1fe22b271c tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "DELETE /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4/os-volume_attachments/cd53aa34-d460-4127-8973-f655de73c9cb" status: 202 len: 0 microversion: 2.1 time: 0.300106 Aug 03 19:28:46.827740 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 533/1063] 10.222.0.77 () {58 vars in 1416 bytes} [Wed Aug 3 19:28:46 2022] DELETE /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4/os-volume_attachments/cd53aa34-d460-4127-8973-f655de73c9cb => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 19:28:47.949626 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_api:SELECT=2 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:28:47.950383 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:28:47.954609 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-80ce6bea-7633-4cb4-9bd9-66175da628f8 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:28:47.964050 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-80ce6bea-7633-4cb4-9bd9-66175da628f8 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: 4ca38833-19b9-4c96-b4f1-f1e81f1839d4] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:28:47.964050 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-80ce6bea-7633-4cb4-9bd9-66175da628f8 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:28:47.964050 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-80ce6bea-7633-4cb4-9bd9-66175da628f8 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:28:47.964050 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-80ce6bea-7633-4cb4-9bd9-66175da628f8 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:28:47.964506 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-80ce6bea-7633-4cb4-9bd9-66175da628f8 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:28:47.989660 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-80ce6bea-7633-4cb4-9bd9-66175da628f8 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: 4ca38833-19b9-4c96-b4f1-f1e81f1839d4] Going to try to terminate instance {{(pid=118302) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 19:28:48.299471 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-80ce6bea-7633-4cb4-9bd9-66175da628f8 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "DELETE /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4" status: 204 len: 0 microversion: 2.1 time: 0.350953 Aug 03 19:28:48.300076 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 531/1064] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 3 19:28:47 2022] DELETE /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 19:28:48.309178 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-72cf4c17-6176-4565-ab32-4faeb4ba32a7 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:28:48.312673 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-72cf4c17-6176-4565-ab32-4faeb4ba32a7 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: 4ca38833-19b9-4c96-b4f1-f1e81f1839d4] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:28:48.316293 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-72cf4c17-6176-4565-ab32-4faeb4ba32a7 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:28:48.316754 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-72cf4c17-6176-4565-ab32-4faeb4ba32a7 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:28:48.317511 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-72cf4c17-6176-4565-ab32-4faeb4ba32a7 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:28:48.318226 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-72cf4c17-6176-4565-ab32-4faeb4ba32a7 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:28:48.463179 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-72cf4c17-6176-4565-ab32-4faeb4ba32a7 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cda314ac5eb4e57aee4dd59b7a407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9946496484a0b8d616790bbdec62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:28:48.471185 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-72cf4c17-6176-4565-ab32-4faeb4ba32a7 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "GET /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4" status: 200 len: 1513 microversion: 2.1 time: 0.166714 Aug 03 19:28:48.471742 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 534/1065] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:28:48 2022] GET /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4 => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:28:49.493299 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-468980aa-bc9d-4341-8fc5-184ecf10b945 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:28:49.494007 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-468980aa-bc9d-4341-8fc5-184ecf10b945 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: 4ca38833-19b9-4c96-b4f1-f1e81f1839d4] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:28:49.500600 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-468980aa-bc9d-4341-8fc5-184ecf10b945 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:28:49.501108 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-468980aa-bc9d-4341-8fc5-184ecf10b945 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:28:49.502008 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-468980aa-bc9d-4341-8fc5-184ecf10b945 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:28:49.502403 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-468980aa-bc9d-4341-8fc5-184ecf10b945 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:28:49.635507 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-468980aa-bc9d-4341-8fc5-184ecf10b945 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cda314ac5eb4e57aee4dd59b7a407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9946496484a0b8d616790bbdec62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:28:49.643754 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-468980aa-bc9d-4341-8fc5-184ecf10b945 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "GET /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4" status: 200 len: 1513 microversion: 2.1 time: 0.154791 Aug 03 19:28:49.644313 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 532/1066] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:28:49 2022] GET /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:28:50.664232 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-545567bc-8202-4921-944b-8981aaaa12c6 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:28:50.664876 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-545567bc-8202-4921-944b-8981aaaa12c6 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: 4ca38833-19b9-4c96-b4f1-f1e81f1839d4] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:28:50.673034 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-545567bc-8202-4921-944b-8981aaaa12c6 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:28:50.673500 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-545567bc-8202-4921-944b-8981aaaa12c6 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:28:50.674362 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-545567bc-8202-4921-944b-8981aaaa12c6 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:28:50.674793 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-545567bc-8202-4921-944b-8981aaaa12c6 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:28:50.744845 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-3e0add8d-59a5-45fc-ad70-56f71799a6e8 req-3c4a2245-25fe-4390-bf74-512e703082db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ca38833-19b9-4c96-b4f1-f1e81f1839d4", "name": "network-vif-deleted", "tag": "6fb8bf05-9eb1-4d06-ad46-405e26edfe25"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:28:50.753354 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-545567bc-8202-4921-944b-8981aaaa12c6 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cda314ac5eb4e57aee4dd59b7a407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9946496484a0b8d616790bbdec62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:28:50.755990 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-3e0add8d-59a5-45fc-ad70-56f71799a6e8 req-3c4a2245-25fe-4390-bf74-512e703082db service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:28:50.756448 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-3e0add8d-59a5-45fc-ad70-56f71799a6e8 req-3c4a2245-25fe-4390-bf74-512e703082db service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:28:50.760937 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-545567bc-8202-4921-944b-8981aaaa12c6 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "GET /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4" status: 200 len: 1471 microversion: 2.1 time: 0.100586 Aug 03 19:28:50.761499 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 535/1067] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:28:50 2022] GET /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4 => generated 1471 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:28:50.767839 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-3e0add8d-59a5-45fc-ad70-56f71799a6e8 req-3c4a2245-25fe-4390-bf74-512e703082db service nova] Creating event network-vif-deleted:6fb8bf05-9eb1-4d06-ad46-405e26edfe25 for instance 4ca38833-19b9-4c96-b4f1-f1e81f1839d4 on hv-cinder-85202 Aug 03 19:28:50.772867 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-3e0add8d-59a5-45fc-ad70-56f71799a6e8 req-3c4a2245-25fe-4390-bf74-512e703082db service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031841 Aug 03 19:28:50.773601 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 533/1068] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:28:51.781899 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-1b854420-2228-4d2b-99b4-554e0aa4b648 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:28:51.782675 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-1b854420-2228-4d2b-99b4-554e0aa4b648 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: 4ca38833-19b9-4c96-b4f1-f1e81f1839d4] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:28:51.789128 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1b854420-2228-4d2b-99b4-554e0aa4b648 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:28:51.789586 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1b854420-2228-4d2b-99b4-554e0aa4b648 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:28:51.790353 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1b854420-2228-4d2b-99b4-554e0aa4b648 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:28:51.790792 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1b854420-2228-4d2b-99b4-554e0aa4b648 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:28:51.804143 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.wsgi [None req-1b854420-2228-4d2b-99b4-554e0aa4b648 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] HTTP exception thrown: Instance 4ca38833-19b9-4c96-b4f1-f1e81f1839d4 could not be found. Aug 03 19:28:51.805848 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-1b854420-2228-4d2b-99b4-554e0aa4b648 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Request method failure captured: Aug 03 19:28:51.805848 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: request: GET /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4 HTTP/1.1 Aug 03 19:28:51.805848 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept: application/json Aug 03 19:28:51.805848 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept-Encoding: identity Aug 03 19:28:51.805848 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Connection: close Aug 03 19:28:51.805848 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Length: 0 Aug 03 19:28:51.805848 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Type: application/json Aug 03 19:28:51.805848 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Host: 10.222.0.77 Aug 03 19:28:51.805848 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Openstack-System-Scope: None Aug 03 19:28:51.805848 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: User-Agent: python-urllib3/1.26.11 Aug 03 19:28:51.805848 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Auth-Token: gAAAAABi6swnAq-2KPtIJy0HRlD71ZMSAXHE0FTIOnfPO61nZnC0xSC5L4_dRkmmzyaRzTu9PPThOP_B90dlPqQbKnpTfrhtewvuhp3gXvS9FHhdjdrO7GJnZSRdM0e0x-rcbPZ1LAxnEJx1ry-g6QuD9eBUnzuwE4OGadVrff9l5kqOtA3Z4Is Aug 03 19:28:51.805848 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Id: None Aug 03 19:28:51.805848 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Name: None Aug 03 19:28:51.805848 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Identity-Status: Confirmed Aug 03 19:28:51.805848 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Is-Admin-Project: True Aug 03 19:28:51.805848 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Id: default Aug 03 19:28:51.805848 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Name: Default Aug 03 19:28:51.805848 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Id: 37f9946496484a0b8d616790bbdec62f Aug 03 19:28:51.805848 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Name: tempest-VolumesSnapshotTestJSON-890879196 Aug 03 19:28:51.805848 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Role: reader,member Aug 03 19:28:51.805848 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Roles: reader,member Aug 03 19:28:51.807802 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_37f9946496484a0b8d616790bbdec62f", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/37f9946496484a0b8d616790bbdec62f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/37f9946496484a0b8d616790bbdec62f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/37f9946496484a0b8d616790bbdec62f"}]}] Aug 03 19:28:51.807802 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant: tempest-VolumesSnapshotTestJSON-890879196 Aug 03 19:28:51.807802 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Id: 37f9946496484a0b8d616790bbdec62f Aug 03 19:28:51.807802 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-890879196 Aug 03 19:28:51.807802 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User: tempest-VolumesSnapshotTestJSON-890879196-project Aug 03 19:28:51.807802 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Id: default Aug 03 19:28:51.807802 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Name: Default Aug 03 19:28:51.807802 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Id: 4cda314ac5eb4e57aee4dd59b7a407ec Aug 03 19:28:51.807802 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Name: tempest-VolumesSnapshotTestJSON-890879196-project Aug 03 19:28:51.807802 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: method: > Aug 03 19:28:51.807802 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: exception: Instance 4ca38833-19b9-4c96-b4f1-f1e81f1839d4 could not be found. Aug 03 19:28:51.807802 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: action_args: {'id': '4ca38833-19b9-4c96-b4f1-f1e81f1839d4'} Aug 03 19:28:51.808903 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:28:51.808903 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:28:51.808903 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:28:51.808903 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:28:51.808903 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:28:51.808903 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:28:51.808903 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:28:51.808903 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:28:51.808903 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:28:51.808903 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:28:51.808903 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ca38833-19b9-4c96-b4f1-f1e81f1839d4 could not be found. Aug 03 19:28:51.808903 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:28:51.808903 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:28:51.808903 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:28:51.808903 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:28:51.808903 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:28:51.808903 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:28:51.808903 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:28:51.808903 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:28:51.808903 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:28:51.811175 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:28:51.811175 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:28:51.811175 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:28:51.811175 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:28:51.811175 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:28:51.811175 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:28:51.811175 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:28:51.811175 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ca38833-19b9-4c96-b4f1-f1e81f1839d4 could not be found. Aug 03 19:28:51.811175 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:28:51.811175 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:28:51.811175 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:28:51.811175 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:28:51.811175 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:28:51.811175 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:28:51.811175 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:28:51.811175 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:28:51.811175 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ca38833-19b9-4c96-b4f1-f1e81f1839d4 could not be found. Aug 03 19:28:51.811175 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:28:51.812756 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-1b854420-2228-4d2b-99b4-554e0aa4b648 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Returning 404 to user: Instance 4ca38833-19b9-4c96-b4f1-f1e81f1839d4 could not be found. {{(pid=118303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:28:51.812756 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-1b854420-2228-4d2b-99b4-554e0aa4b648 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "GET /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4" status: 404 len: 111 microversion: 2.1 time: 0.029278 Aug 03 19:28:51.812756 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 536/1069] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:28:51 2022] GET /compute/v2.1/servers/4ca38833-19b9-4c96-b4f1-f1e81f1839d4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 19:29:03.187062 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:29:03.192275 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:29:03.192574 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-61114c81-b970-4b90-8c5a-6a4d90bf59e5 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1824088865", "imageRef": "0b6be242-215e-4886-a0d2-b8d5f8ca623e", "flavorRef": "452", "networks": [{"uuid": "69831f20-12da-4198-83ad-b445946b05ea"}]}} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:29:03.244420 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.network.neutron [None req-61114c81-b970-4b90-8c5a-6a4d90bf59e5 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] validate_networks() for [('69831f20-12da-4198-83ad-b445946b05ea', None, None, None, None, None)] {{(pid=118302) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 19:29:03.644254 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-61114c81-b970-4b90-8c5a-6a4d90bf59e5 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Flavor limits 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 19:29:03.644879 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-61114c81-b970-4b90-8c5a-6a4d90bf59e5 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Image limits 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 19:29:03.645358 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-61114c81-b970-4b90-8c5a-6a4d90bf59e5 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Flavor pref 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 19:29:03.645772 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-61114c81-b970-4b90-8c5a-6a4d90bf59e5 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Image pref 0:0:0 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 19:29:03.646191 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.virt.hardware [None req-61114c81-b970-4b90-8c5a-6a4d90bf59e5 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 19:29:03.655113 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-61114c81-b970-4b90-8c5a-6a4d90bf59e5 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:29:03.655567 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-61114c81-b970-4b90-8c5a-6a4d90bf59e5 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:29:03.656403 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-61114c81-b970-4b90-8c5a-6a4d90bf59e5 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:29:03.656843 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-61114c81-b970-4b90-8c5a-6a4d90bf59e5 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:29:03.673452 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.quota [None req-61114c81-b970-4b90-8c5a-6a4d90bf59e5 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Getting quotas for project 37f9946496484a0b8d616790bbdec62f. Resources: {'instances', 'cores', 'ram'} {{(pid=118302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:29:03.677505 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.quota [None req-61114c81-b970-4b90-8c5a-6a4d90bf59e5 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Getting quotas for user 4cda314ac5eb4e57aee4dd59b7a407ec and project 37f9946496484a0b8d616790bbdec62f. Resources: {'instances', 'cores', 'ram'} {{(pid=118302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:29:03.688278 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-61114c81-b970-4b90-8c5a-6a4d90bf59e5 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Going to run 1 instances... {{(pid=118302) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 19:29:03.691180 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-61114c81-b970-4b90-8c5a-6a4d90bf59e5 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: acfc00c4-d4cd-47f8-aca2-7b4c69d04c20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0b6be242-215e-4886-a0d2-b8d5f8ca623e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 19:29:03.829601 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-61114c81-b970-4b90-8c5a-6a4d90bf59e5 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.643900 Aug 03 19:29:03.830382 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 534/1070] 10.222.0.77 () {60 vars in 1147 bytes} [Wed Aug 3 19:29:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 19:29:03.842146 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-e0f5acd8-74e9-4f3c-b424-fd5c594a8021 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:29:03.842840 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-e0f5acd8-74e9-4f3c-b424-fd5c594a8021 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: acfc00c4-d4cd-47f8-aca2-7b4c69d04c20] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:29:03.845851 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_api:SELECT=8 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:29:03.846277 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:29:03.902486 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-e0f5acd8-74e9-4f3c-b424-fd5c594a8021 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cda314ac5eb4e57aee4dd59b7a407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9946496484a0b8d616790bbdec62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:29:03.909490 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-e0f5acd8-74e9-4f3c-b424-fd5c594a8021 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "GET /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20" status: 200 len: 1219 microversion: 2.1 time: 0.071172 Aug 03 19:29:03.910142 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 537/1071] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:29:03 2022] GET /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20 => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:29:04.929566 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-679623e7-cf0c-437d-be91-c4ea3dc5fe6e tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:29:04.930182 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-679623e7-cf0c-437d-be91-c4ea3dc5fe6e tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: acfc00c4-d4cd-47f8-aca2-7b4c69d04c20] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:29:04.984328 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-679623e7-cf0c-437d-be91-c4ea3dc5fe6e tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cda314ac5eb4e57aee4dd59b7a407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9946496484a0b8d616790bbdec62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:29:04.991341 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-679623e7-cf0c-437d-be91-c4ea3dc5fe6e tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "GET /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20" status: 200 len: 1219 microversion: 2.1 time: 0.065601 Aug 03 19:29:04.991890 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 535/1072] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:29:04 2022] GET /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20 => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:29:06.012179 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-21af245d-ccd9-4630-9a88-d624ac5fadaa tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:29:06.012795 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-21af245d-ccd9-4630-9a88-d624ac5fadaa tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: acfc00c4-d4cd-47f8-aca2-7b4c69d04c20] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:29:06.068710 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-21af245d-ccd9-4630-9a88-d624ac5fadaa tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cda314ac5eb4e57aee4dd59b7a407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9946496484a0b8d616790bbdec62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:29:06.075749 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-21af245d-ccd9-4630-9a88-d624ac5fadaa tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "GET /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20" status: 200 len: 1219 microversion: 2.1 time: 0.067667 Aug 03 19:29:06.076315 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 538/1073] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:29:06 2022] GET /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20 => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:29:07.096783 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-126458d5-0b36-4331-acd9-0e36f7ee6f76 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:29:07.097486 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-126458d5-0b36-4331-acd9-0e36f7ee6f76 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: acfc00c4-d4cd-47f8-aca2-7b4c69d04c20] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:29:07.149601 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-126458d5-0b36-4331-acd9-0e36f7ee6f76 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cda314ac5eb4e57aee4dd59b7a407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9946496484a0b8d616790bbdec62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:29:07.156212 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-126458d5-0b36-4331-acd9-0e36f7ee6f76 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "GET /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20" status: 200 len: 1219 microversion: 2.1 time: 0.063319 Aug 03 19:29:07.156776 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 536/1074] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:29:07 2022] GET /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20 => generated 1219 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:29:08.177046 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-ee7a0e04-7d54-400c-80ba-01812a44508e tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:29:08.177604 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-ee7a0e04-7d54-400c-80ba-01812a44508e tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: acfc00c4-d4cd-47f8-aca2-7b4c69d04c20] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:29:08.183768 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ee7a0e04-7d54-400c-80ba-01812a44508e tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:29:08.184220 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ee7a0e04-7d54-400c-80ba-01812a44508e tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:29:08.184979 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ee7a0e04-7d54-400c-80ba-01812a44508e tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:29:08.185415 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ee7a0e04-7d54-400c-80ba-01812a44508e tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:29:08.252244 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-ee7a0e04-7d54-400c-80ba-01812a44508e tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cda314ac5eb4e57aee4dd59b7a407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9946496484a0b8d616790bbdec62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:29:08.260136 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-ee7a0e04-7d54-400c-80ba-01812a44508e tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "GET /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20" status: 200 len: 1271 microversion: 2.1 time: 0.087734 Aug 03 19:29:08.260689 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 539/1075] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:29:08 2022] GET /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20 => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:29:09.280705 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-b080fed6-8278-49cf-83e0-83cab2466233 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:29:09.281322 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-b080fed6-8278-49cf-83e0-83cab2466233 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: acfc00c4-d4cd-47f8-aca2-7b4c69d04c20] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:29:09.288889 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b080fed6-8278-49cf-83e0-83cab2466233 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:29:09.289348 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b080fed6-8278-49cf-83e0-83cab2466233 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:29:09.290123 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b080fed6-8278-49cf-83e0-83cab2466233 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:29:09.290563 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b080fed6-8278-49cf-83e0-83cab2466233 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:29:09.426191 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-b080fed6-8278-49cf-83e0-83cab2466233 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cda314ac5eb4e57aee4dd59b7a407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9946496484a0b8d616790bbdec62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:29:09.433766 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-b080fed6-8278-49cf-83e0-83cab2466233 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "GET /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20" status: 200 len: 1319 microversion: 2.1 time: 0.156990 Aug 03 19:29:09.434413 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 537/1076] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:29:09 2022] GET /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:29:10.355159 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [req-bf2e2370-7baf-49bb-8f24-b23d28f9e0d3 req-ddd20edc-c941-47fe-a87e-85b4d118afd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acfc00c4-d4cd-47f8-aca2-7b4c69d04c20", "tag": "2abfe2c5-b818-4136-addf-9b06b135c85d"}]} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:29:10.366527 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-bf2e2370-7baf-49bb-8f24-b23d28f9e0d3 req-ddd20edc-c941-47fe-a87e-85b4d118afd2 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:29:10.367139 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-bf2e2370-7baf-49bb-8f24-b23d28f9e0d3 req-ddd20edc-c941-47fe-a87e-85b4d118afd2 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:29:10.383146 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.compute.server_external_events [req-bf2e2370-7baf-49bb-8f24-b23d28f9e0d3 req-ddd20edc-c941-47fe-a87e-85b4d118afd2 service nova] Creating event network-changed:2abfe2c5-b818-4136-addf-9b06b135c85d for instance acfc00c4-d4cd-47f8-aca2-7b4c69d04c20 on hv-cinder-85202 Aug 03 19:29:10.388652 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [req-bf2e2370-7baf-49bb-8f24-b23d28f9e0d3 req-ddd20edc-c941-47fe-a87e-85b4d118afd2 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037209 Aug 03 19:29:10.389858 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 540/1077] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:29:10.459312 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-c16a48f7-0909-4785-880b-b56b7b090e2a tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:29:10.459875 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-c16a48f7-0909-4785-880b-b56b7b090e2a tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: acfc00c4-d4cd-47f8-aca2-7b4c69d04c20] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:29:10.467452 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c16a48f7-0909-4785-880b-b56b7b090e2a tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:29:10.472862 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c16a48f7-0909-4785-880b-b56b7b090e2a tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:29:10.472862 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c16a48f7-0909-4785-880b-b56b7b090e2a tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:29:10.472862 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-c16a48f7-0909-4785-880b-b56b7b090e2a tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:29:10.611296 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-c16a48f7-0909-4785-880b-b56b7b090e2a tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cda314ac5eb4e57aee4dd59b7a407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9946496484a0b8d616790bbdec62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:29:10.619691 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-c16a48f7-0909-4785-880b-b56b7b090e2a tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "GET /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20" status: 200 len: 1319 microversion: 2.1 time: 0.165753 Aug 03 19:29:10.624580 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 538/1078] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:29:10 2022] GET /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:29:11.642789 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-cbac8f81-55a4-42dc-b0c0-2e66e78333b6 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:29:11.685699 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-cbac8f81-55a4-42dc-b0c0-2e66e78333b6 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: acfc00c4-d4cd-47f8-aca2-7b4c69d04c20] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:29:11.685699 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cbac8f81-55a4-42dc-b0c0-2e66e78333b6 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:29:11.685699 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cbac8f81-55a4-42dc-b0c0-2e66e78333b6 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:29:11.685699 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cbac8f81-55a4-42dc-b0c0-2e66e78333b6 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:29:11.686158 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cbac8f81-55a4-42dc-b0c0-2e66e78333b6 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:29:11.840780 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-cbac8f81-55a4-42dc-b0c0-2e66e78333b6 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cda314ac5eb4e57aee4dd59b7a407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9946496484a0b8d616790bbdec62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:29:11.848457 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-cbac8f81-55a4-42dc-b0c0-2e66e78333b6 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "GET /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20" status: 200 len: 1319 microversion: 2.1 time: 0.210436 Aug 03 19:29:11.849021 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 541/1079] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:29:11 2022] GET /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20 => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:29:12.868688 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-f7484c53-c95b-4e00-8857-c7794350dd41 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:29:12.869299 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-f7484c53-c95b-4e00-8857-c7794350dd41 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: acfc00c4-d4cd-47f8-aca2-7b4c69d04c20] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:29:12.876030 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f7484c53-c95b-4e00-8857-c7794350dd41 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:29:12.876479 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f7484c53-c95b-4e00-8857-c7794350dd41 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:29:12.877240 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f7484c53-c95b-4e00-8857-c7794350dd41 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:29:12.877678 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f7484c53-c95b-4e00-8857-c7794350dd41 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:29:13.007734 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-f7484c53-c95b-4e00-8857-c7794350dd41 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cda314ac5eb4e57aee4dd59b7a407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9946496484a0b8d616790bbdec62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:29:13.015160 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-f7484c53-c95b-4e00-8857-c7794350dd41 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "GET /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20" status: 200 len: 1319 microversion: 2.1 time: 0.150341 Aug 03 19:29:13.015722 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 539/1080] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:29:12 2022] GET /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:29:14.036977 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-c0361947-dabd-49b1-a784-951eecba2410 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:29:14.037650 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-c0361947-dabd-49b1-a784-951eecba2410 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: acfc00c4-d4cd-47f8-aca2-7b4c69d04c20] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:29:14.044146 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c0361947-dabd-49b1-a784-951eecba2410 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:29:14.044593 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c0361947-dabd-49b1-a784-951eecba2410 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:29:14.045351 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c0361947-dabd-49b1-a784-951eecba2410 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:29:14.045784 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-c0361947-dabd-49b1-a784-951eecba2410 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:29:14.178134 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-c0361947-dabd-49b1-a784-951eecba2410 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cda314ac5eb4e57aee4dd59b7a407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9946496484a0b8d616790bbdec62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:29:14.185576 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-c0361947-dabd-49b1-a784-951eecba2410 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "GET /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20" status: 200 len: 1319 microversion: 2.1 time: 0.153324 Aug 03 19:29:14.186134 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 542/1081] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:29:14 2022] GET /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:29:15.205810 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-2d039ee9-d74d-4c89-897e-9ee257c4ace3 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:29:15.210456 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-2d039ee9-d74d-4c89-897e-9ee257c4ace3 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: acfc00c4-d4cd-47f8-aca2-7b4c69d04c20] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:29:15.210456 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell0:SELECT=2 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:29:15.214097 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2d039ee9-d74d-4c89-897e-9ee257c4ace3 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:29:15.214555 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2d039ee9-d74d-4c89-897e-9ee257c4ace3 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:29:15.215371 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2d039ee9-d74d-4c89-897e-9ee257c4ace3 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:29:15.215814 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2d039ee9-d74d-4c89-897e-9ee257c4ace3 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:29:15.351793 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-2d039ee9-d74d-4c89-897e-9ee257c4ace3 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cda314ac5eb4e57aee4dd59b7a407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9946496484a0b8d616790bbdec62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:29:15.359206 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-2d039ee9-d74d-4c89-897e-9ee257c4ace3 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "GET /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20" status: 200 len: 1319 microversion: 2.1 time: 0.157305 Aug 03 19:29:15.359769 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 540/1082] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:29:15 2022] GET /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:29:16.379506 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-adc68473-0470-4f7a-909f-4da370be86cf tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:29:16.380121 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-adc68473-0470-4f7a-909f-4da370be86cf tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: acfc00c4-d4cd-47f8-aca2-7b4c69d04c20] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:29:16.382492 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell0:SELECT=4 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:29:16.387301 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-adc68473-0470-4f7a-909f-4da370be86cf tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:29:16.387751 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-adc68473-0470-4f7a-909f-4da370be86cf tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:29:16.388507 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-adc68473-0470-4f7a-909f-4da370be86cf tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:29:16.388938 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-adc68473-0470-4f7a-909f-4da370be86cf tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:29:16.519445 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-adc68473-0470-4f7a-909f-4da370be86cf tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cda314ac5eb4e57aee4dd59b7a407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9946496484a0b8d616790bbdec62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:29:16.527049 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-adc68473-0470-4f7a-909f-4da370be86cf tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "GET /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20" status: 200 len: 1319 microversion: 2.1 time: 0.151710 Aug 03 19:29:16.527606 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 543/1083] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:29:16 2022] GET /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:29:16.775486 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-af1c9e9d-9750-4694-9da5-951c25cbb3df req-0a5f3eff-dd86-44b0-8772-9aeaeb92ec8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acfc00c4-d4cd-47f8-aca2-7b4c69d04c20", "name": "network-vif-plugged", "status": "completed", "tag": "2abfe2c5-b818-4136-addf-9b06b135c85d"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:29:16.785453 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-af1c9e9d-9750-4694-9da5-951c25cbb3df req-0a5f3eff-dd86-44b0-8772-9aeaeb92ec8c service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:29:16.785905 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-af1c9e9d-9750-4694-9da5-951c25cbb3df req-0a5f3eff-dd86-44b0-8772-9aeaeb92ec8c service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:29:16.797054 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-af1c9e9d-9750-4694-9da5-951c25cbb3df req-0a5f3eff-dd86-44b0-8772-9aeaeb92ec8c service nova] Creating event network-vif-plugged:2abfe2c5-b818-4136-addf-9b06b135c85d for instance acfc00c4-d4cd-47f8-aca2-7b4c69d04c20 on hv-cinder-85202 Aug 03 19:29:16.802416 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-af1c9e9d-9750-4694-9da5-951c25cbb3df req-0a5f3eff-dd86-44b0-8772-9aeaeb92ec8c service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030705 Aug 03 19:29:16.802996 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 541/1084] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:29:17.547359 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-60fd0834-30de-4889-9df6-9944d30da796 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:29:17.547969 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-60fd0834-30de-4889-9df6-9944d30da796 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: acfc00c4-d4cd-47f8-aca2-7b4c69d04c20] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:29:17.555205 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-60fd0834-30de-4889-9df6-9944d30da796 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:29:17.555652 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-60fd0834-30de-4889-9df6-9944d30da796 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:29:17.556410 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-60fd0834-30de-4889-9df6-9944d30da796 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:29:17.556850 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-60fd0834-30de-4889-9df6-9944d30da796 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:29:17.688649 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-60fd0834-30de-4889-9df6-9944d30da796 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cda314ac5eb4e57aee4dd59b7a407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9946496484a0b8d616790bbdec62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:29:17.697542 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-60fd0834-30de-4889-9df6-9944d30da796 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "GET /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20" status: 200 len: 1319 microversion: 2.1 time: 0.154062 Aug 03 19:29:17.698241 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 544/1085] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:29:17 2022] GET /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:29:18.715558 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell0:SELECT=10 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:29:18.720509 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-01ccb646-58cb-45ef-83a6-4b2adcc3a580 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:29:18.721241 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-01ccb646-58cb-45ef-83a6-4b2adcc3a580 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: acfc00c4-d4cd-47f8-aca2-7b4c69d04c20] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:29:18.728169 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-01ccb646-58cb-45ef-83a6-4b2adcc3a580 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:29:18.728622 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-01ccb646-58cb-45ef-83a6-4b2adcc3a580 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:29:18.729392 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-01ccb646-58cb-45ef-83a6-4b2adcc3a580 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:29:18.729828 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-01ccb646-58cb-45ef-83a6-4b2adcc3a580 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:29:18.863112 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-01ccb646-58cb-45ef-83a6-4b2adcc3a580 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cda314ac5eb4e57aee4dd59b7a407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9946496484a0b8d616790bbdec62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:29:18.870820 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-01ccb646-58cb-45ef-83a6-4b2adcc3a580 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "GET /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20" status: 200 len: 1319 microversion: 2.1 time: 0.156246 Aug 03 19:29:18.871426 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 542/1086] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:29:18 2022] GET /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:29:19.891006 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-3e648b23-e94d-4975-846f-afc0372f76b4 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:29:19.891615 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-3e648b23-e94d-4975-846f-afc0372f76b4 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: acfc00c4-d4cd-47f8-aca2-7b4c69d04c20] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:29:19.898564 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3e648b23-e94d-4975-846f-afc0372f76b4 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:29:19.899041 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3e648b23-e94d-4975-846f-afc0372f76b4 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:29:19.899805 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3e648b23-e94d-4975-846f-afc0372f76b4 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:29:19.900241 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3e648b23-e94d-4975-846f-afc0372f76b4 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:29:20.031284 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-3e648b23-e94d-4975-846f-afc0372f76b4 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cda314ac5eb4e57aee4dd59b7a407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9946496484a0b8d616790bbdec62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:29:20.039231 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-3e648b23-e94d-4975-846f-afc0372f76b4 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "GET /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20" status: 200 len: 1508 microversion: 2.1 time: 0.152076 Aug 03 19:29:20.039823 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 545/1087] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:29:19 2022] GET /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:29:20.059553 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-734f5750-8ceb-4ae6-a44e-f78ea21c62c5 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "afc12256-d30b-4724-bfb8-e52a5c47703b", "device": "/dev/sdb"}} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:29:20.061919 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-734f5750-8ceb-4ae6-a44e-f78ea21c62c5 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: acfc00c4-d4cd-47f8-aca2-7b4c69d04c20] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:29:20.068525 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-734f5750-8ceb-4ae6-a44e-f78ea21c62c5 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:29:20.069233 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-734f5750-8ceb-4ae6-a44e-f78ea21c62c5 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:29:20.069995 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-734f5750-8ceb-4ae6-a44e-f78ea21c62c5 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:29:20.070431 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-734f5750-8ceb-4ae6-a44e-f78ea21c62c5 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:29:20.942102 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-734f5750-8ceb-4ae6-a44e-f78ea21c62c5 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "POST /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.886161 Aug 03 19:29:20.943496 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 543/1088] 10.222.0.77 () {60 vars in 1323 bytes} [Wed Aug 3 19:29:20 2022] POST /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20/os-volume_attachments => generated 194 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:29:23.241602 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 19:29:23.242300 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Wed Aug 3 19:29:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 19:29:43.076967 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-f4fb56f9-fc02-432d-a989-a4030a41d429 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:29:43.085414 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-f4fb56f9-fc02-432d-a989-a4030a41d429 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: acfc00c4-d4cd-47f8-aca2-7b4c69d04c20] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:29:43.085414 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_api:SELECT=22 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:29:43.085414 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=38 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:29:43.085414 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f4fb56f9-fc02-432d-a989-a4030a41d429 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:29:43.085414 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f4fb56f9-fc02-432d-a989-a4030a41d429 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:29:43.086137 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f4fb56f9-fc02-432d-a989-a4030a41d429 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:29:43.086574 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f4fb56f9-fc02-432d-a989-a4030a41d429 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:29:43.168987 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.objects.instance [None req-f4fb56f9-fc02-432d-a989-a4030a41d429 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lazy-loading 'services' on Instance uuid acfc00c4-d4cd-47f8-aca2-7b4c69d04c20 {{(pid=118303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:29:43.332593 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-f4fb56f9-fc02-432d-a989-a4030a41d429 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "DELETE /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20/os-volume_attachments/afc12256-d30b-4724-bfb8-e52a5c47703b" status: 202 len: 0 microversion: 2.1 time: 0.259457 Aug 03 19:29:43.333135 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 546/1089] 10.222.0.77 () {58 vars in 1416 bytes} [Wed Aug 3 19:29:43 2022] DELETE /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20/os-volume_attachments/afc12256-d30b-4724-bfb8-e52a5c47703b => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 19:29:44.458770 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-6c65f977-f360-4edb-8feb-3b7bc03f0e50 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:29:44.459391 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-6c65f977-f360-4edb-8feb-3b7bc03f0e50 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: acfc00c4-d4cd-47f8-aca2-7b4c69d04c20] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:29:44.462458 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:29:44.463172 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:29:44.468178 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-6c65f977-f360-4edb-8feb-3b7bc03f0e50 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:29:44.468640 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-6c65f977-f360-4edb-8feb-3b7bc03f0e50 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:29:44.469465 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-6c65f977-f360-4edb-8feb-3b7bc03f0e50 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:29:44.470092 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-6c65f977-f360-4edb-8feb-3b7bc03f0e50 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:29:44.495648 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-6c65f977-f360-4edb-8feb-3b7bc03f0e50 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: acfc00c4-d4cd-47f8-aca2-7b4c69d04c20] Going to try to terminate instance {{(pid=118302) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 19:29:44.790464 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-6c65f977-f360-4edb-8feb-3b7bc03f0e50 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "DELETE /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20" status: 204 len: 0 microversion: 2.1 time: 0.335711 Aug 03 19:29:44.791078 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 544/1090] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 3 19:29:44 2022] DELETE /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 19:29:44.800166 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-d49a44b9-5a65-4c99-ac77-f62a210c04e4 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:29:44.800949 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-d49a44b9-5a65-4c99-ac77-f62a210c04e4 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: acfc00c4-d4cd-47f8-aca2-7b4c69d04c20] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:29:44.807919 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d49a44b9-5a65-4c99-ac77-f62a210c04e4 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:29:44.812645 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d49a44b9-5a65-4c99-ac77-f62a210c04e4 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:29:44.812645 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d49a44b9-5a65-4c99-ac77-f62a210c04e4 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:29:44.812645 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d49a44b9-5a65-4c99-ac77-f62a210c04e4 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:29:44.938452 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-d49a44b9-5a65-4c99-ac77-f62a210c04e4 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cda314ac5eb4e57aee4dd59b7a407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9946496484a0b8d616790bbdec62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:29:44.946821 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-d49a44b9-5a65-4c99-ac77-f62a210c04e4 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "GET /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20" status: 200 len: 1514 microversion: 2.1 time: 0.150727 Aug 03 19:29:44.947587 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 547/1091] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:29:44 2022] GET /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:29:45.968905 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-13d030fb-3cd5-4bc0-a373-c94f561eb5d1 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:29:45.969526 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-13d030fb-3cd5-4bc0-a373-c94f561eb5d1 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: acfc00c4-d4cd-47f8-aca2-7b4c69d04c20] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:29:45.976018 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-13d030fb-3cd5-4bc0-a373-c94f561eb5d1 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:29:45.976499 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-13d030fb-3cd5-4bc0-a373-c94f561eb5d1 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:29:45.977341 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-13d030fb-3cd5-4bc0-a373-c94f561eb5d1 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:29:45.978468 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-13d030fb-3cd5-4bc0-a373-c94f561eb5d1 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:29:46.112796 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-13d030fb-3cd5-4bc0-a373-c94f561eb5d1 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cda314ac5eb4e57aee4dd59b7a407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9946496484a0b8d616790bbdec62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:29:46.120922 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-13d030fb-3cd5-4bc0-a373-c94f561eb5d1 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "GET /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20" status: 200 len: 1514 microversion: 2.1 time: 0.156426 Aug 03 19:29:46.121489 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 545/1092] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:29:45 2022] GET /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:29:46.547277 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 19:29:46.547823 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Wed Aug 3 19:29:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 19:29:47.141522 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-04355757-c906-4767-a995-622b339dd393 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:29:47.142162 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-04355757-c906-4767-a995-622b339dd393 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: acfc00c4-d4cd-47f8-aca2-7b4c69d04c20] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:29:47.150085 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-04355757-c906-4767-a995-622b339dd393 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:29:47.150543 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-04355757-c906-4767-a995-622b339dd393 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:29:47.151427 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-04355757-c906-4767-a995-622b339dd393 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:29:47.151827 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-04355757-c906-4767-a995-622b339dd393 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:29:47.200307 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [req-1e4fa1da-20f0-4ef6-85f3-1b462136c58f req-88093373-dfa0-4cd0-89f7-4072a1f19a1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acfc00c4-d4cd-47f8-aca2-7b4c69d04c20", "name": "network-vif-deleted", "tag": "2abfe2c5-b818-4136-addf-9b06b135c85d"}]} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:29:47.209735 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-1e4fa1da-20f0-4ef6-85f3-1b462136c58f req-88093373-dfa0-4cd0-89f7-4072a1f19a1a service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:29:47.210174 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-1e4fa1da-20f0-4ef6-85f3-1b462136c58f req-88093373-dfa0-4cd0-89f7-4072a1f19a1a service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:29:47.221058 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-04355757-c906-4767-a995-622b339dd393 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cda314ac5eb4e57aee4dd59b7a407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9946496484a0b8d616790bbdec62f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:29:47.223929 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.compute.server_external_events [req-1e4fa1da-20f0-4ef6-85f3-1b462136c58f req-88093373-dfa0-4cd0-89f7-4072a1f19a1a service nova] Creating event network-vif-deleted:2abfe2c5-b818-4136-addf-9b06b135c85d for instance acfc00c4-d4cd-47f8-aca2-7b4c69d04c20 on hv-cinder-85202 Aug 03 19:29:47.228801 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [req-1e4fa1da-20f0-4ef6-85f3-1b462136c58f req-88093373-dfa0-4cd0-89f7-4072a1f19a1a service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096601 Aug 03 19:29:47.229117 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-04355757-c906-4767-a995-622b339dd393 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "GET /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20" status: 200 len: 1472 microversion: 2.1 time: 0.091653 Aug 03 19:29:47.229568 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 548/1093] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:29:47.229940 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 546/1094] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:29:47 2022] GET /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20 => generated 1472 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:29:48.250692 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-4176d801-1dcc-4f76-9ead-86cb564cd726 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:29:48.251463 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-4176d801-1dcc-4f76-9ead-86cb564cd726 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] [instance: acfc00c4-d4cd-47f8-aca2-7b4c69d04c20] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:29:48.258133 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4176d801-1dcc-4f76-9ead-86cb564cd726 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:29:48.264510 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4176d801-1dcc-4f76-9ead-86cb564cd726 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:29:48.264510 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4176d801-1dcc-4f76-9ead-86cb564cd726 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:29:48.264510 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-4176d801-1dcc-4f76-9ead-86cb564cd726 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:29:48.273724 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.wsgi [None req-4176d801-1dcc-4f76-9ead-86cb564cd726 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] HTTP exception thrown: Instance acfc00c4-d4cd-47f8-aca2-7b4c69d04c20 could not be found. Aug 03 19:29:48.275975 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-4176d801-1dcc-4f76-9ead-86cb564cd726 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Request method failure captured: Aug 03 19:29:48.275975 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: request: GET /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20 HTTP/1.1 Aug 03 19:29:48.275975 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept: application/json Aug 03 19:29:48.275975 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept-Encoding: identity Aug 03 19:29:48.275975 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Connection: close Aug 03 19:29:48.275975 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Length: 0 Aug 03 19:29:48.275975 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Type: application/json Aug 03 19:29:48.275975 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Host: 10.222.0.77 Aug 03 19:29:48.275975 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Openstack-System-Scope: None Aug 03 19:29:48.275975 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: User-Agent: python-urllib3/1.26.11 Aug 03 19:29:48.275975 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Auth-Token: gAAAAABi6swnAq-2KPtIJy0HRlD71ZMSAXHE0FTIOnfPO61nZnC0xSC5L4_dRkmmzyaRzTu9PPThOP_B90dlPqQbKnpTfrhtewvuhp3gXvS9FHhdjdrO7GJnZSRdM0e0x-rcbPZ1LAxnEJx1ry-g6QuD9eBUnzuwE4OGadVrff9l5kqOtA3Z4Is Aug 03 19:29:48.275975 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Id: None Aug 03 19:29:48.275975 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Name: None Aug 03 19:29:48.275975 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Identity-Status: Confirmed Aug 03 19:29:48.275975 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Is-Admin-Project: True Aug 03 19:29:48.275975 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Id: default Aug 03 19:29:48.275975 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Name: Default Aug 03 19:29:48.275975 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Id: 37f9946496484a0b8d616790bbdec62f Aug 03 19:29:48.275975 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Name: tempest-VolumesSnapshotTestJSON-890879196 Aug 03 19:29:48.275975 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Role: reader,member Aug 03 19:29:48.275975 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Roles: reader,member Aug 03 19:29:48.277817 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_37f9946496484a0b8d616790bbdec62f", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/37f9946496484a0b8d616790bbdec62f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/37f9946496484a0b8d616790bbdec62f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/37f9946496484a0b8d616790bbdec62f"}]}] Aug 03 19:29:48.277817 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant: tempest-VolumesSnapshotTestJSON-890879196 Aug 03 19:29:48.277817 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Id: 37f9946496484a0b8d616790bbdec62f Aug 03 19:29:48.277817 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-890879196 Aug 03 19:29:48.277817 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User: tempest-VolumesSnapshotTestJSON-890879196-project Aug 03 19:29:48.277817 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Id: default Aug 03 19:29:48.277817 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Name: Default Aug 03 19:29:48.277817 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Id: 4cda314ac5eb4e57aee4dd59b7a407ec Aug 03 19:29:48.277817 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Name: tempest-VolumesSnapshotTestJSON-890879196-project Aug 03 19:29:48.277817 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: method: > Aug 03 19:29:48.277817 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: exception: Instance acfc00c4-d4cd-47f8-aca2-7b4c69d04c20 could not be found. Aug 03 19:29:48.277817 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: action_args: {'id': 'acfc00c4-d4cd-47f8-aca2-7b4c69d04c20'} Aug 03 19:29:48.278864 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:29:48.278864 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:29:48.278864 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:29:48.278864 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:29:48.278864 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:29:48.278864 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:29:48.278864 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:29:48.278864 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:29:48.278864 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:29:48.278864 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:29:48.278864 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acfc00c4-d4cd-47f8-aca2-7b4c69d04c20 could not be found. Aug 03 19:29:48.278864 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:29:48.278864 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:29:48.278864 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:29:48.278864 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:29:48.278864 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:29:48.278864 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:29:48.278864 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:29:48.278864 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:29:48.278864 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:29:48.280870 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:29:48.280870 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:29:48.280870 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:29:48.280870 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:29:48.280870 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:29:48.280870 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:29:48.280870 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:29:48.280870 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acfc00c4-d4cd-47f8-aca2-7b4c69d04c20 could not be found. Aug 03 19:29:48.280870 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:29:48.280870 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:29:48.280870 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:29:48.280870 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:29:48.280870 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:29:48.280870 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:29:48.280870 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:29:48.280870 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:29:48.280870 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acfc00c4-d4cd-47f8-aca2-7b4c69d04c20 could not be found. Aug 03 19:29:48.280870 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:29:48.282800 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-4176d801-1dcc-4f76-9ead-86cb564cd726 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] Returning 404 to user: Instance acfc00c4-d4cd-47f8-aca2-7b4c69d04c20 could not be found. {{(pid=118303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:29:48.282800 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-4176d801-1dcc-4f76-9ead-86cb564cd726 tempest-VolumesSnapshotTestJSON-890879196 tempest-VolumesSnapshotTestJSON-890879196-project] 10.222.0.77 "GET /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20" status: 404 len: 111 microversion: 2.1 time: 0.031457 Aug 03 19:29:48.282800 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 549/1095] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:29:48 2022] GET /compute/v2.1/servers/acfc00c4-d4cd-47f8-aca2-7b4c69d04c20 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:30:53.289083 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:30:53.289922 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:30:53.293812 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-e6db5cf9-28fe-4837-ab2f-fd9f0332a589 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Action: 'create', calling method: .version_select at 0x7f4786da7160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-257815558", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6UbOQr2z82z5zeyGzz3QmNiQuchoZSoHEUCptOfHi/nxxClzB7FlAjrAKHFtx5gZKvLKFLiOxHDW9TtGVMZoAgWVO0yja0Ilp7RngkktUN8pRC/fQNyiE0S45XdrbQRw=="}} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:30:53.310564 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.quota [None req-e6db5cf9-28fe-4837-ab2f-fd9f0332a589 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Getting quotas for project 0063fd85b78e44b982c319f653962203. Resources: {'key_pairs'} {{(pid=118302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:30:53.314375 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.quota [None req-e6db5cf9-28fe-4837-ab2f-fd9f0332a589 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Getting quotas for user f00bd48f8f6d4a2fa23aca557ce7cec2 and project 0063fd85b78e44b982c319f653962203. Resources: {'key_pairs'} {{(pid=118302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:30:53.414791 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-e6db5cf9-28fe-4837-ab2f-fd9f0332a589 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.128090 Aug 03 19:30:53.415418 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 547/1096] 10.222.0.77 () {60 vars in 1159 bytes} [Wed Aug 3 19:30:53 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:30:53.468176 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_api:SELECT=8 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:30:53.469138 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:30:53.475346 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-dc21ae48-ce70-4ed1-a5ca-08482533cd0a tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-229765037", "imageRef": "5da3e5c3-5a15-48ee-85d8-006cf0c99cc7", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-257815558", "networks": [{"uuid": "e3b0fa62-040f-4953-a4b7-7432b6942805"}]}} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:30:53.530310 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.network.neutron [None req-dc21ae48-ce70-4ed1-a5ca-08482533cd0a tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] validate_networks() for [('e3b0fa62-040f-4953-a4b7-7432b6942805', None, None, None, None, None)] {{(pid=118303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 19:30:53.995854 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-dc21ae48-ce70-4ed1-a5ca-08482533cd0a tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Flavor limits 0:0:0 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 19:30:53.996288 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-dc21ae48-ce70-4ed1-a5ca-08482533cd0a tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Image limits 0:0:0 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 19:30:53.996763 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-dc21ae48-ce70-4ed1-a5ca-08482533cd0a tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Flavor pref 0:0:0 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 19:30:53.997173 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-dc21ae48-ce70-4ed1-a5ca-08482533cd0a tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Image pref 0:0:0 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 19:30:53.997588 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.virt.hardware [None req-dc21ae48-ce70-4ed1-a5ca-08482533cd0a tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 19:30:54.006411 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-dc21ae48-ce70-4ed1-a5ca-08482533cd0a tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:30:54.006861 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-dc21ae48-ce70-4ed1-a5ca-08482533cd0a tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:30:54.007697 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-dc21ae48-ce70-4ed1-a5ca-08482533cd0a tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:30:54.008187 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-dc21ae48-ce70-4ed1-a5ca-08482533cd0a tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:30:54.024652 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.quota [None req-dc21ae48-ce70-4ed1-a5ca-08482533cd0a tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Getting quotas for project 0063fd85b78e44b982c319f653962203. Resources: {'instances', 'cores', 'ram'} {{(pid=118303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:30:54.028598 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.quota [None req-dc21ae48-ce70-4ed1-a5ca-08482533cd0a tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Getting quotas for user f00bd48f8f6d4a2fa23aca557ce7cec2 and project 0063fd85b78e44b982c319f653962203. Resources: {'instances', 'cores', 'ram'} {{(pid=118303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:30:54.039428 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-dc21ae48-ce70-4ed1-a5ca-08482533cd0a tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Going to run 1 instances... {{(pid=118303) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 19:30:54.042425 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-dc21ae48-ce70-4ed1-a5ca-08482533cd0a tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5da3e5c3-5a15-48ee-85d8-006cf0c99cc7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 19:30:54.315681 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-dc21ae48-ce70-4ed1-a5ca-08482533cd0a tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.849492 Aug 03 19:30:54.316622 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 550/1097] 10.222.0.77 () {60 vars in 1147 bytes} [Wed Aug 3 19:30:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 19:30:54.329954 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-039691a5-a45f-4b5e-a2c5-9b5acf6e7969 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:30:54.331804 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-039691a5-a45f-4b5e-a2c5-9b5acf6e7969 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:30:54.389579 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-039691a5-a45f-4b5e-a2c5-9b5acf6e7969 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00bd48f8f6d4a2fa23aca557ce7cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0063fd85b78e44b982c319f653962203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:30:54.397092 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-039691a5-a45f-4b5e-a2c5-9b5acf6e7969 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8" status: 200 len: 1257 microversion: 2.1 time: 0.072749 Aug 03 19:30:54.397951 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 548/1098] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:30:54 2022] GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8 => generated 1257 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:30:55.418931 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-f477cda1-2538-413b-8b72-73e1b8778465 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:30:55.419507 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-f477cda1-2538-413b-8b72-73e1b8778465 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:30:55.425727 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f477cda1-2538-413b-8b72-73e1b8778465 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:30:55.426181 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f477cda1-2538-413b-8b72-73e1b8778465 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:30:55.426965 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f477cda1-2538-413b-8b72-73e1b8778465 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:30:55.427410 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f477cda1-2538-413b-8b72-73e1b8778465 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:30:55.488901 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-f477cda1-2538-413b-8b72-73e1b8778465 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00bd48f8f6d4a2fa23aca557ce7cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0063fd85b78e44b982c319f653962203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:30:55.497671 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-f477cda1-2538-413b-8b72-73e1b8778465 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8" status: 200 len: 1261 microversion: 2.1 time: 0.083880 Aug 03 19:30:55.498238 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 551/1099] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:30:55 2022] GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8 => generated 1261 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:30:56.517798 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-74311be3-7ebe-424d-9e5e-8cd7d16110b4 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:30:56.518432 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-74311be3-7ebe-424d-9e5e-8cd7d16110b4 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:30:56.526424 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-74311be3-7ebe-424d-9e5e-8cd7d16110b4 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:30:56.540270 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-74311be3-7ebe-424d-9e5e-8cd7d16110b4 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:30:56.540270 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-74311be3-7ebe-424d-9e5e-8cd7d16110b4 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:30:56.540270 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-74311be3-7ebe-424d-9e5e-8cd7d16110b4 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:30:56.591904 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-74311be3-7ebe-424d-9e5e-8cd7d16110b4 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00bd48f8f6d4a2fa23aca557ce7cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0063fd85b78e44b982c319f653962203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:30:56.599260 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-74311be3-7ebe-424d-9e5e-8cd7d16110b4 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8" status: 200 len: 1317 microversion: 2.1 time: 0.085501 Aug 03 19:30:56.599825 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 549/1100] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:30:56 2022] GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8 => generated 1317 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:30:57.622623 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-243f30d1-8368-4fd5-b2df-42868c9f3a3a tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:30:57.624044 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-243f30d1-8368-4fd5-b2df-42868c9f3a3a tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:30:57.635816 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-243f30d1-8368-4fd5-b2df-42868c9f3a3a tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:30:57.636605 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-243f30d1-8368-4fd5-b2df-42868c9f3a3a tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:30:57.637804 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-243f30d1-8368-4fd5-b2df-42868c9f3a3a tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:30:57.638624 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-243f30d1-8368-4fd5-b2df-42868c9f3a3a tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:30:57.812458 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-243f30d1-8368-4fd5-b2df-42868c9f3a3a tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00bd48f8f6d4a2fa23aca557ce7cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0063fd85b78e44b982c319f653962203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:30:57.822826 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-243f30d1-8368-4fd5-b2df-42868c9f3a3a tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8" status: 200 len: 1357 microversion: 2.1 time: 0.205275 Aug 03 19:30:57.833104 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 552/1101] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:30:57 2022] GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8 => generated 1357 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:30:58.854686 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-92360d8b-d6a6-41fa-a01a-0574c41d8dc6 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:30:58.855464 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-92360d8b-d6a6-41fa-a01a-0574c41d8dc6 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:30:58.862370 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-92360d8b-d6a6-41fa-a01a-0574c41d8dc6 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:30:58.862911 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-92360d8b-d6a6-41fa-a01a-0574c41d8dc6 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:30:58.864066 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-92360d8b-d6a6-41fa-a01a-0574c41d8dc6 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:30:58.864684 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-92360d8b-d6a6-41fa-a01a-0574c41d8dc6 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:30:59.005258 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-92360d8b-d6a6-41fa-a01a-0574c41d8dc6 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00bd48f8f6d4a2fa23aca557ce7cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0063fd85b78e44b982c319f653962203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:30:59.015724 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-92360d8b-d6a6-41fa-a01a-0574c41d8dc6 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8" status: 200 len: 1357 microversion: 2.1 time: 0.165731 Aug 03 19:30:59.023431 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 550/1102] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:30:58 2022] GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:31:00.037483 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-d1b9ffd6-342d-4215-b223-d0455d63bb75 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:31:00.038162 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-d1b9ffd6-342d-4215-b223-d0455d63bb75 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:31:00.045581 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d1b9ffd6-342d-4215-b223-d0455d63bb75 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:00.046032 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d1b9ffd6-342d-4215-b223-d0455d63bb75 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:00.046817 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d1b9ffd6-342d-4215-b223-d0455d63bb75 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:00.047292 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d1b9ffd6-342d-4215-b223-d0455d63bb75 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:00.194064 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-d1b9ffd6-342d-4215-b223-d0455d63bb75 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00bd48f8f6d4a2fa23aca557ce7cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0063fd85b78e44b982c319f653962203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:31:00.203421 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-d1b9ffd6-342d-4215-b223-d0455d63bb75 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8" status: 200 len: 1357 microversion: 2.1 time: 0.170006 Aug 03 19:31:00.217224 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 553/1103] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:31:00 2022] GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8 => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:31:01.225148 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-b705d456-c90f-490b-8408-ec5ffcbcff9f tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:31:01.225748 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-b705d456-c90f-490b-8408-ec5ffcbcff9f tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:31:01.233243 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b705d456-c90f-490b-8408-ec5ffcbcff9f tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:01.233692 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b705d456-c90f-490b-8408-ec5ffcbcff9f tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:01.234521 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b705d456-c90f-490b-8408-ec5ffcbcff9f tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:01.234972 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b705d456-c90f-490b-8408-ec5ffcbcff9f tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:01.374484 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-b705d456-c90f-490b-8408-ec5ffcbcff9f tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00bd48f8f6d4a2fa23aca557ce7cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0063fd85b78e44b982c319f653962203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:31:01.382268 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-b705d456-c90f-490b-8408-ec5ffcbcff9f tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8" status: 200 len: 1357 microversion: 2.1 time: 0.161218 Aug 03 19:31:01.382931 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 551/1104] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:31:01 2022] GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:31:02.404508 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-3e0985f7-093d-46bb-af0a-6659ee03618c tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:31:02.405905 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-3e0985f7-093d-46bb-af0a-6659ee03618c tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:31:02.413592 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3e0985f7-093d-46bb-af0a-6659ee03618c tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:02.414527 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3e0985f7-093d-46bb-af0a-6659ee03618c tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:02.415699 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3e0985f7-093d-46bb-af0a-6659ee03618c tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:02.416200 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-3e0985f7-093d-46bb-af0a-6659ee03618c tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:02.577729 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-3e0985f7-093d-46bb-af0a-6659ee03618c tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00bd48f8f6d4a2fa23aca557ce7cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0063fd85b78e44b982c319f653962203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:31:02.587188 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-3e0985f7-093d-46bb-af0a-6659ee03618c tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8" status: 200 len: 1357 microversion: 2.1 time: 0.185643 Aug 03 19:31:02.587596 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 554/1105] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:31:02 2022] GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8 => generated 1357 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:31:03.613625 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-b920d58f-6b16-4a1f-9d0e-4881fef5d5f4 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:31:03.614519 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-b920d58f-6b16-4a1f-9d0e-4881fef5d5f4 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:31:03.632178 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b920d58f-6b16-4a1f-9d0e-4881fef5d5f4 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:03.635581 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b920d58f-6b16-4a1f-9d0e-4881fef5d5f4 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:03.635581 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b920d58f-6b16-4a1f-9d0e-4881fef5d5f4 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:03.635581 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-b920d58f-6b16-4a1f-9d0e-4881fef5d5f4 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:03.864526 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-b920d58f-6b16-4a1f-9d0e-4881fef5d5f4 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00bd48f8f6d4a2fa23aca557ce7cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0063fd85b78e44b982c319f653962203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:31:03.874412 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-b920d58f-6b16-4a1f-9d0e-4881fef5d5f4 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8" status: 200 len: 1357 microversion: 2.1 time: 0.269591 Aug 03 19:31:03.876257 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 552/1106] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:31:03 2022] GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8 => generated 1357 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:31:04.037738 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [req-9ed166e6-a6b8-40d3-b2ac-7ef5907e0db0 req-c4cda435-bf3d-4d89-ba54-fbb7d0b4dc62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c73ab949-c9f1-4152-a9f1-84a503833fc8", "tag": "60fd94e5-b5fb-4414-b41b-7cd0f629d165"}]} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:31:04.047367 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell0:SELECT=2 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:31:04.048244 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell0:SELECT=6 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:31:04.050521 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-9ed166e6-a6b8-40d3-b2ac-7ef5907e0db0 req-c4cda435-bf3d-4d89-ba54-fbb7d0b4dc62 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:04.050992 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-9ed166e6-a6b8-40d3-b2ac-7ef5907e0db0 req-c4cda435-bf3d-4d89-ba54-fbb7d0b4dc62 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:04.064064 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.compute.server_external_events [req-9ed166e6-a6b8-40d3-b2ac-7ef5907e0db0 req-c4cda435-bf3d-4d89-ba54-fbb7d0b4dc62 service nova] Creating event network-changed:60fd94e5-b5fb-4414-b41b-7cd0f629d165 for instance c73ab949-c9f1-4152-a9f1-84a503833fc8 on hv-cinder-85202 Aug 03 19:31:04.070233 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [req-9ed166e6-a6b8-40d3-b2ac-7ef5907e0db0 req-c4cda435-bf3d-4d89-ba54-fbb7d0b4dc62 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036366 Aug 03 19:31:04.072735 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 555/1107] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:31:04.896667 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-2012a4bf-f901-41b1-9f03-ed2bd11d1732 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:31:04.897235 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-2012a4bf-f901-41b1-9f03-ed2bd11d1732 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:31:04.899060 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell0:SELECT=6 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:31:04.904409 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2012a4bf-f901-41b1-9f03-ed2bd11d1732 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:04.904856 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2012a4bf-f901-41b1-9f03-ed2bd11d1732 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:04.905622 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2012a4bf-f901-41b1-9f03-ed2bd11d1732 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:04.906058 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-2012a4bf-f901-41b1-9f03-ed2bd11d1732 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:05.037113 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-2012a4bf-f901-41b1-9f03-ed2bd11d1732 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00bd48f8f6d4a2fa23aca557ce7cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0063fd85b78e44b982c319f653962203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:31:05.045398 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-2012a4bf-f901-41b1-9f03-ed2bd11d1732 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8" status: 200 len: 1357 microversion: 2.1 time: 0.152701 Aug 03 19:31:05.045959 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 553/1108] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:31:04 2022] GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:31:06.067911 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-bf6ac8d6-9054-40cd-b255-921f1354d29b tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:31:06.068530 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-bf6ac8d6-9054-40cd-b255-921f1354d29b tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:31:06.076401 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-bf6ac8d6-9054-40cd-b255-921f1354d29b tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:06.076880 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-bf6ac8d6-9054-40cd-b255-921f1354d29b tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:06.077639 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-bf6ac8d6-9054-40cd-b255-921f1354d29b tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:06.078077 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-bf6ac8d6-9054-40cd-b255-921f1354d29b tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:06.210617 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-bf6ac8d6-9054-40cd-b255-921f1354d29b tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00bd48f8f6d4a2fa23aca557ce7cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0063fd85b78e44b982c319f653962203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:31:06.217989 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-bf6ac8d6-9054-40cd-b255-921f1354d29b tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8" status: 200 len: 1357 microversion: 2.1 time: 0.155301 Aug 03 19:31:06.218554 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 556/1109] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:31:06 2022] GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:31:07.239391 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-26b10ba6-9521-419d-846d-e119a52aa4ab tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:31:07.240166 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-26b10ba6-9521-419d-846d-e119a52aa4ab tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:31:07.247692 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-26b10ba6-9521-419d-846d-e119a52aa4ab tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:07.248206 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-26b10ba6-9521-419d-846d-e119a52aa4ab tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:07.249067 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-26b10ba6-9521-419d-846d-e119a52aa4ab tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:07.249518 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-26b10ba6-9521-419d-846d-e119a52aa4ab tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:07.381013 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-26b10ba6-9521-419d-846d-e119a52aa4ab tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00bd48f8f6d4a2fa23aca557ce7cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0063fd85b78e44b982c319f653962203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:31:07.389583 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-26b10ba6-9521-419d-846d-e119a52aa4ab tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8" status: 200 len: 1357 microversion: 2.1 time: 0.154657 Aug 03 19:31:07.390158 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 554/1110] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:31:07 2022] GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:31:08.410906 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-5f4c3420-f083-42a8-94ff-287acb03f88c tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:31:08.411514 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-5f4c3420-f083-42a8-94ff-287acb03f88c tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:31:08.418589 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5f4c3420-f083-42a8-94ff-287acb03f88c tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:08.419067 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5f4c3420-f083-42a8-94ff-287acb03f88c tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:08.419821 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5f4c3420-f083-42a8-94ff-287acb03f88c tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:08.420251 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-5f4c3420-f083-42a8-94ff-287acb03f88c tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:08.549394 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-5f4c3420-f083-42a8-94ff-287acb03f88c tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00bd48f8f6d4a2fa23aca557ce7cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0063fd85b78e44b982c319f653962203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:31:08.557081 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-5f4c3420-f083-42a8-94ff-287acb03f88c tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8" status: 200 len: 1357 microversion: 2.1 time: 0.150194 Aug 03 19:31:08.557643 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 557/1111] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:31:08 2022] GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:31:09.577801 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-072310a9-fe47-4122-b302-c95f498fa065 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:31:09.578355 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-072310a9-fe47-4122-b302-c95f498fa065 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:31:09.584915 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-072310a9-fe47-4122-b302-c95f498fa065 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:09.585370 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-072310a9-fe47-4122-b302-c95f498fa065 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:09.586133 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-072310a9-fe47-4122-b302-c95f498fa065 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:09.586697 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-072310a9-fe47-4122-b302-c95f498fa065 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:09.714396 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-072310a9-fe47-4122-b302-c95f498fa065 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00bd48f8f6d4a2fa23aca557ce7cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0063fd85b78e44b982c319f653962203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:31:09.721795 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-072310a9-fe47-4122-b302-c95f498fa065 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8" status: 200 len: 1357 microversion: 2.1 time: 0.147970 Aug 03 19:31:09.722359 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 555/1112] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:31:09 2022] GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8 => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:31:10.744763 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-d8ec1346-1e6d-4a17-b0a4-a3b2cf046eb6 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:31:10.745416 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-d8ec1346-1e6d-4a17-b0a4-a3b2cf046eb6 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:31:10.751975 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d8ec1346-1e6d-4a17-b0a4-a3b2cf046eb6 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:10.752424 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d8ec1346-1e6d-4a17-b0a4-a3b2cf046eb6 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:10.753188 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d8ec1346-1e6d-4a17-b0a4-a3b2cf046eb6 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:10.753624 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d8ec1346-1e6d-4a17-b0a4-a3b2cf046eb6 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:10.887632 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-d8ec1346-1e6d-4a17-b0a4-a3b2cf046eb6 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00bd48f8f6d4a2fa23aca557ce7cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0063fd85b78e44b982c319f653962203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:31:10.896466 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-d8ec1346-1e6d-4a17-b0a4-a3b2cf046eb6 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8" status: 200 len: 1357 microversion: 2.1 time: 0.157197 Aug 03 19:31:10.897024 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 558/1113] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:31:10 2022] GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:31:11.917551 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-5b71343d-f1fb-4482-b7cf-6c88a20c9fd3 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:31:11.918158 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-5b71343d-f1fb-4482-b7cf-6c88a20c9fd3 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:31:11.926973 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-5b71343d-f1fb-4482-b7cf-6c88a20c9fd3 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:11.927657 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-5b71343d-f1fb-4482-b7cf-6c88a20c9fd3 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:11.928863 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-5b71343d-f1fb-4482-b7cf-6c88a20c9fd3 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:11.929548 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-5b71343d-f1fb-4482-b7cf-6c88a20c9fd3 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:12.076511 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-5b71343d-f1fb-4482-b7cf-6c88a20c9fd3 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00bd48f8f6d4a2fa23aca557ce7cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0063fd85b78e44b982c319f653962203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:31:12.083907 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-5b71343d-f1fb-4482-b7cf-6c88a20c9fd3 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8" status: 200 len: 1357 microversion: 2.1 time: 0.170416 Aug 03 19:31:12.084471 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 556/1114] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:31:11 2022] GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8 => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:31:13.105387 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-8bb47bcc-fa29-425a-a120-fe2dbcd48ef5 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:31:13.106004 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-8bb47bcc-fa29-425a-a120-fe2dbcd48ef5 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:31:13.112504 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8bb47bcc-fa29-425a-a120-fe2dbcd48ef5 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:13.112956 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8bb47bcc-fa29-425a-a120-fe2dbcd48ef5 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:13.113717 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8bb47bcc-fa29-425a-a120-fe2dbcd48ef5 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:13.114188 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8bb47bcc-fa29-425a-a120-fe2dbcd48ef5 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:13.250153 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-8dc6203e-c59e-47ae-99bd-34cd32956493 req-88286342-f97a-47c6-9fd7-f6215e5789ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c73ab949-c9f1-4152-a9f1-84a503833fc8", "name": "network-vif-plugged", "status": "completed", "tag": "60fd94e5-b5fb-4414-b41b-7cd0f629d165"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:31:13.255747 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-8bb47bcc-fa29-425a-a120-fe2dbcd48ef5 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00bd48f8f6d4a2fa23aca557ce7cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0063fd85b78e44b982c319f653962203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:31:13.261146 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-8bb47bcc-fa29-425a-a120-fe2dbcd48ef5 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8" status: 200 len: 1357 microversion: 2.1 time: 0.160430 Aug 03 19:31:13.261753 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 559/1115] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:31:13 2022] GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:31:13.262574 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-8dc6203e-c59e-47ae-99bd-34cd32956493 req-88286342-f97a-47c6-9fd7-f6215e5789ec service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:13.263065 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-8dc6203e-c59e-47ae-99bd-34cd32956493 req-88286342-f97a-47c6-9fd7-f6215e5789ec service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:13.274459 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-8dc6203e-c59e-47ae-99bd-34cd32956493 req-88286342-f97a-47c6-9fd7-f6215e5789ec service nova] Creating event network-vif-plugged:60fd94e5-b5fb-4414-b41b-7cd0f629d165 for instance c73ab949-c9f1-4152-a9f1-84a503833fc8 on hv-cinder-85202 Aug 03 19:31:13.280718 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-8dc6203e-c59e-47ae-99bd-34cd32956493 req-88286342-f97a-47c6-9fd7-f6215e5789ec service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035313 Aug 03 19:31:13.286450 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 557/1116] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:31:14.281855 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-cb51bdf3-4680-4ab7-b605-1029f623d0b4 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:31:14.282462 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-cb51bdf3-4680-4ab7-b605-1029f623d0b4 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:31:14.288949 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cb51bdf3-4680-4ab7-b605-1029f623d0b4 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:14.289391 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cb51bdf3-4680-4ab7-b605-1029f623d0b4 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:14.290206 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cb51bdf3-4680-4ab7-b605-1029f623d0b4 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:14.291786 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-cb51bdf3-4680-4ab7-b605-1029f623d0b4 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:14.446770 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-cb51bdf3-4680-4ab7-b605-1029f623d0b4 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00bd48f8f6d4a2fa23aca557ce7cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0063fd85b78e44b982c319f653962203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:31:14.454492 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-cb51bdf3-4680-4ab7-b605-1029f623d0b4 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8" status: 200 len: 1357 microversion: 2.1 time: 0.176528 Aug 03 19:31:14.455075 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 560/1117] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:31:14 2022] GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8 => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:31:15.475958 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-f65619ef-eb1d-4855-a052-17f16997b48b tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:31:15.476681 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-f65619ef-eb1d-4855-a052-17f16997b48b tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:31:15.483858 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f65619ef-eb1d-4855-a052-17f16997b48b tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:15.484305 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f65619ef-eb1d-4855-a052-17f16997b48b tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:15.485065 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f65619ef-eb1d-4855-a052-17f16997b48b tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:15.485501 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f65619ef-eb1d-4855-a052-17f16997b48b tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:15.615249 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-f65619ef-eb1d-4855-a052-17f16997b48b tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00bd48f8f6d4a2fa23aca557ce7cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0063fd85b78e44b982c319f653962203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:31:15.623709 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-f65619ef-eb1d-4855-a052-17f16997b48b tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8" status: 200 len: 1547 microversion: 2.1 time: 0.152762 Aug 03 19:31:15.624315 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 558/1118] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:31:15 2022] GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8 => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:31:15.643437 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-96f15ecc-d801-4ba2-82a5-2fb25b8fd55e tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:31:15.644104 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-96f15ecc-d801-4ba2-82a5-2fb25b8fd55e tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:31:15.650515 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-96f15ecc-d801-4ba2-82a5-2fb25b8fd55e tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:15.650966 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-96f15ecc-d801-4ba2-82a5-2fb25b8fd55e tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:15.651737 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-96f15ecc-d801-4ba2-82a5-2fb25b8fd55e tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:15.652171 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-96f15ecc-d801-4ba2-82a5-2fb25b8fd55e tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:15.779811 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-96f15ecc-d801-4ba2-82a5-2fb25b8fd55e tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00bd48f8f6d4a2fa23aca557ce7cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0063fd85b78e44b982c319f653962203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:31:15.787382 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-96f15ecc-d801-4ba2-82a5-2fb25b8fd55e tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8" status: 200 len: 1547 microversion: 2.1 time: 0.147681 Aug 03 19:31:15.787945 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 561/1119] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:31:15 2022] GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8 => generated 1547 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:31:15.807774 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-89771348-6331-4b5e-add2-02433f47edfa tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:31:15.812472 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-89771348-6331-4b5e-add2-02433f47edfa tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f00bd48f8f6d4a2fa23aca557ce7cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0063fd85b78e44b982c319f653962203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:31:15.813315 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-89771348-6331-4b5e-add2-02433f47edfa tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Searching by: {'deleted': False, 'project_id': '0063fd85b78e44b982c319f653962203'} {{(pid=118302) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 19:31:15.820034 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-89771348-6331-4b5e-add2-02433f47edfa tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:15.820491 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-89771348-6331-4b5e-add2-02433f47edfa tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:15.821288 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-89771348-6331-4b5e-add2-02433f47edfa tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:15.821764 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-89771348-6331-4b5e-add2-02433f47edfa tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:15.911869 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.multi_cell_list [None req-89771348-6331-4b5e-add2-02433f47edfa tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118302) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 19:31:16.008213 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-89771348-6331-4b5e-add2-02433f47edfa tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.204898 Aug 03 19:31:16.008792 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 559/1120] 10.222.0.77 () {58 vars in 1125 bytes} [Wed Aug 3 19:31:15 2022] GET /compute/v2.1/servers => generated 342 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:31:16.019903 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-699b35bc-9253-47ac-ac79-3c3c9332e3c1 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:31:16.020538 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-699b35bc-9253-47ac-ac79-3c3c9332e3c1 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:31:16.027251 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-699b35bc-9253-47ac-ac79-3c3c9332e3c1 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:16.027694 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-699b35bc-9253-47ac-ac79-3c3c9332e3c1 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:16.028444 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-699b35bc-9253-47ac-ac79-3c3c9332e3c1 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:16.028873 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-699b35bc-9253-47ac-ac79-3c3c9332e3c1 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:16.158398 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-699b35bc-9253-47ac-ac79-3c3c9332e3c1 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00bd48f8f6d4a2fa23aca557ce7cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0063fd85b78e44b982c319f653962203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:31:16.166964 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-699b35bc-9253-47ac-ac79-3c3c9332e3c1 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8" status: 200 len: 1547 microversion: 2.1 time: 0.150959 Aug 03 19:31:16.167540 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 562/1121] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:31:16 2022] GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8 => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:31:18.089128 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-8eadf915-3a17-4d92-b96e-5129ac5f0903 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18afccc5-e8ce-4fba-ae50-033e042bba60"}} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:31:18.091527 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-8eadf915-3a17-4d92-b96e-5129ac5f0903 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:31:18.098164 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8eadf915-3a17-4d92-b96e-5129ac5f0903 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:18.098620 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8eadf915-3a17-4d92-b96e-5129ac5f0903 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:18.099460 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8eadf915-3a17-4d92-b96e-5129ac5f0903 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:18.099922 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-8eadf915-3a17-4d92-b96e-5129ac5f0903 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:18.822084 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-8eadf915-3a17-4d92-b96e-5129ac5f0903 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "POST /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.736950 Aug 03 19:31:18.823622 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 560/1122] 10.222.0.77 () {60 vars in 1323 bytes} [Wed Aug 3 19:31:18 2022] POST /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8/os-volume_attachments => generated 194 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:31:26.398744 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-38508fff-22f0-4ad2-a9a5-815c92056568 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:31:26.399394 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-38508fff-22f0-4ad2-a9a5-815c92056568 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:31:26.402775 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:31:26.403504 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=70 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:31:26.408192 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-38508fff-22f0-4ad2-a9a5-815c92056568 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:26.408659 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-38508fff-22f0-4ad2-a9a5-815c92056568 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:26.409435 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-38508fff-22f0-4ad2-a9a5-815c92056568 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:26.409874 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-38508fff-22f0-4ad2-a9a5-815c92056568 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:26.537880 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-38508fff-22f0-4ad2-a9a5-815c92056568 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00bd48f8f6d4a2fa23aca557ce7cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0063fd85b78e44b982c319f653962203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:31:26.546565 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-38508fff-22f0-4ad2-a9a5-815c92056568 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8" status: 200 len: 1593 microversion: 2.1 time: 0.151664 Aug 03 19:31:26.547158 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 563/1123] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:31:26 2022] GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8 => generated 1593 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:31:28.212434 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 19:31:28.212951 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Wed Aug 3 19:31:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 19:31:28.679321 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell0:SELECT=2 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:31:28.680324 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:31:28.686255 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-ac58e513-42a6-451a-aeb5-1edb8869d9d5 req-9392970c-df5b-41aa-88bf-0f09f8eb0b22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c73ab949-c9f1-4152-a9f1-84a503833fc8", "tag": "60fd94e5-b5fb-4414-b41b-7cd0f629d165"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:31:28.698754 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-ac58e513-42a6-451a-aeb5-1edb8869d9d5 req-9392970c-df5b-41aa-88bf-0f09f8eb0b22 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:28.699461 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-ac58e513-42a6-451a-aeb5-1edb8869d9d5 req-9392970c-df5b-41aa-88bf-0f09f8eb0b22 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:28.703915 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:31:28.710928 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-ac58e513-42a6-451a-aeb5-1edb8869d9d5 req-9392970c-df5b-41aa-88bf-0f09f8eb0b22 service nova] Creating event network-changed:60fd94e5-b5fb-4414-b41b-7cd0f629d165 for instance c73ab949-c9f1-4152-a9f1-84a503833fc8 on hv-cinder-85202 Aug 03 19:31:28.716667 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-ac58e513-42a6-451a-aeb5-1edb8869d9d5 req-9392970c-df5b-41aa-88bf-0f09f8eb0b22 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038923 Aug 03 19:31:28.717273 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 561/1124] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:31:31.057403 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-a08006fc-aa3d-48e3-915d-566522143c96 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-530965985"}} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:31:31.058018 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-a08006fc-aa3d-48e3-915d-566522143c96 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:31:31.064526 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a08006fc-aa3d-48e3-915d-566522143c96 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:31.067144 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a08006fc-aa3d-48e3-915d-566522143c96 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:31.067144 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a08006fc-aa3d-48e3-915d-566522143c96 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:31.067144 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-a08006fc-aa3d-48e3-915d-566522143c96 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:31.191586 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.network.security_group_api [None req-a08006fc-aa3d-48e3-915d-566522143c96 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Adding security group 60d6d02d-1e95-4c1e-b1c3-710f18f2a447 to port 60fd94e5-b5fb-4414-b41b-7cd0f629d165 Aug 03 19:31:31.557297 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-a08006fc-aa3d-48e3-915d-566522143c96 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "POST /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8/action" status: 202 len: 0 microversion: 2.1 time: 0.503805 Aug 03 19:31:31.558480 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 564/1125] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 3 19:31:31 2022] POST /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 19:31:31.568731 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-f078a411-54c8-4332-991a-9bca29ac4e69 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:31:31.569682 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-f078a411-54c8-4332-991a-9bca29ac4e69 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:31:31.578555 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f078a411-54c8-4332-991a-9bca29ac4e69 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:31.579047 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f078a411-54c8-4332-991a-9bca29ac4e69 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:31.579826 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f078a411-54c8-4332-991a-9bca29ac4e69 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:31.580464 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-f078a411-54c8-4332-991a-9bca29ac4e69 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:31.719148 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [req-fcf56f73-983c-4bbc-b016-b485f1898086 req-d1fefe02-dc8f-4867-9bd7-1bb4cdf9f2e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c73ab949-c9f1-4152-a9f1-84a503833fc8", "tag": "60fd94e5-b5fb-4414-b41b-7cd0f629d165"}]} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:31:31.729964 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-fcf56f73-983c-4bbc-b016-b485f1898086 req-d1fefe02-dc8f-4867-9bd7-1bb4cdf9f2e6 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:31:31.731138 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-fcf56f73-983c-4bbc-b016-b485f1898086 req-d1fefe02-dc8f-4867-9bd7-1bb4cdf9f2e6 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:31:31.742798 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.compute.server_external_events [req-fcf56f73-983c-4bbc-b016-b485f1898086 req-d1fefe02-dc8f-4867-9bd7-1bb4cdf9f2e6 service nova] Creating event network-changed:60fd94e5-b5fb-4414-b41b-7cd0f629d165 for instance c73ab949-c9f1-4152-a9f1-84a503833fc8 on hv-cinder-85202 Aug 03 19:31:31.749145 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [req-fcf56f73-983c-4bbc-b016-b485f1898086 req-d1fefe02-dc8f-4867-9bd7-1bb4cdf9f2e6 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185297 Aug 03 19:31:31.749671 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-f078a411-54c8-4332-991a-9bca29ac4e69 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00bd48f8f6d4a2fa23aca557ce7cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0063fd85b78e44b982c319f653962203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:31:31.749829 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 565/1126] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:31:31.759768 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-f078a411-54c8-4332-991a-9bca29ac4e69 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8" status: 200 len: 1758 microversion: 2.1 time: 0.195827 Aug 03 19:31:31.760346 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 562/1127] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:31:31 2022] GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8 => generated 1758 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:32:29.157785 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_api:SELECT=6 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:32:29.158701 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=12 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:32:29.162983 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-737c8130-b761-4b0c-8be2-e5193e6fc1bd tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:32:29.165282 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-737c8130-b761-4b0c-8be2-e5193e6fc1bd tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:32:29.171592 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-737c8130-b761-4b0c-8be2-e5193e6fc1bd tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:32:29.172042 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-737c8130-b761-4b0c-8be2-e5193e6fc1bd tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:32:29.172818 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-737c8130-b761-4b0c-8be2-e5193e6fc1bd tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:32:29.173322 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-737c8130-b761-4b0c-8be2-e5193e6fc1bd tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:32:29.417329 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-737c8130-b761-4b0c-8be2-e5193e6fc1bd tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "POST /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8/action" status: 202 len: 0 microversion: 2.1 time: 0.260802 Aug 03 19:32:29.417876 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 566/1128] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 3 19:32:29 2022] POST /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 19:32:29.427521 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-cd9d2ef5-90c4-49f4-9fcb-6ea7cce061e7 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:32:29.428308 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-cd9d2ef5-90c4-49f4-9fcb-6ea7cce061e7 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:32:29.430659 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_api:SELECT=4 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:32:29.431466 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=7 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:32:29.436440 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-cd9d2ef5-90c4-49f4-9fcb-6ea7cce061e7 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:32:29.445330 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-cd9d2ef5-90c4-49f4-9fcb-6ea7cce061e7 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:32:29.445330 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-cd9d2ef5-90c4-49f4-9fcb-6ea7cce061e7 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:32:29.445330 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-cd9d2ef5-90c4-49f4-9fcb-6ea7cce061e7 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:32:29.589135 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-cd9d2ef5-90c4-49f4-9fcb-6ea7cce061e7 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00bd48f8f6d4a2fa23aca557ce7cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0063fd85b78e44b982c319f653962203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:32:29.599581 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-cd9d2ef5-90c4-49f4-9fcb-6ea7cce061e7 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8" status: 200 len: 1750 microversion: 2.1 time: 0.177252 Aug 03 19:32:29.600168 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 563/1129] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:32:29 2022] GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8 => generated 1750 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:32:30.621182 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-47d26076-b080-4d60-8ae0-6442cf7829ef tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:32:30.621822 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-47d26076-b080-4d60-8ae0-6442cf7829ef tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:32:30.629197 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-47d26076-b080-4d60-8ae0-6442cf7829ef tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:32:30.629648 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-47d26076-b080-4d60-8ae0-6442cf7829ef tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:32:30.630412 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-47d26076-b080-4d60-8ae0-6442cf7829ef tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:32:30.630851 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-47d26076-b080-4d60-8ae0-6442cf7829ef tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:32:30.776319 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-47d26076-b080-4d60-8ae0-6442cf7829ef tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00bd48f8f6d4a2fa23aca557ce7cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0063fd85b78e44b982c319f653962203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:32:30.784438 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-47d26076-b080-4d60-8ae0-6442cf7829ef tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8" status: 200 len: 1755 microversion: 2.1 time: 0.167638 Aug 03 19:32:30.785013 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 567/1130] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:32:30 2022] GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:32:31.806799 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-a24ccaaa-b71e-4c07-8adb-3657b4913a94 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:32:31.807494 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-a24ccaaa-b71e-4c07-8adb-3657b4913a94 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:32:31.815818 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a24ccaaa-b71e-4c07-8adb-3657b4913a94 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:32:31.816279 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a24ccaaa-b71e-4c07-8adb-3657b4913a94 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:32:31.817066 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a24ccaaa-b71e-4c07-8adb-3657b4913a94 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:32:31.817512 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-a24ccaaa-b71e-4c07-8adb-3657b4913a94 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:32:31.965816 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-a24ccaaa-b71e-4c07-8adb-3657b4913a94 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00bd48f8f6d4a2fa23aca557ce7cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0063fd85b78e44b982c319f653962203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:32:31.975199 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-a24ccaaa-b71e-4c07-8adb-3657b4913a94 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8" status: 200 len: 1755 microversion: 2.1 time: 0.173540 Aug 03 19:32:31.975762 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 564/1131] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:32:31 2022] GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:32:32.996980 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-1fcf2bae-f33b-4072-9ff0-6614a4634305 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:32:32.997579 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-1fcf2bae-f33b-4072-9ff0-6614a4634305 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:32:33.004636 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1fcf2bae-f33b-4072-9ff0-6614a4634305 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:32:33.005082 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1fcf2bae-f33b-4072-9ff0-6614a4634305 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:32:33.006060 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1fcf2bae-f33b-4072-9ff0-6614a4634305 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:32:33.006494 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-1fcf2bae-f33b-4072-9ff0-6614a4634305 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:32:33.155868 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-1fcf2bae-f33b-4072-9ff0-6614a4634305 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00bd48f8f6d4a2fa23aca557ce7cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0063fd85b78e44b982c319f653962203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:32:33.164964 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-1fcf2bae-f33b-4072-9ff0-6614a4634305 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8" status: 200 len: 1755 microversion: 2.1 time: 0.171906 Aug 03 19:32:33.169779 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 568/1132] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:32:32 2022] GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:32:34.186317 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-ca41dae0-3e90-4bd2-93c7-f9663b034b4f tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:32:34.186917 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-ca41dae0-3e90-4bd2-93c7-f9663b034b4f tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:32:34.195195 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ca41dae0-3e90-4bd2-93c7-f9663b034b4f tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:32:34.195642 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ca41dae0-3e90-4bd2-93c7-f9663b034b4f tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:32:34.196442 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ca41dae0-3e90-4bd2-93c7-f9663b034b4f tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:32:34.196879 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ca41dae0-3e90-4bd2-93c7-f9663b034b4f tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:32:34.342452 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-ca41dae0-3e90-4bd2-93c7-f9663b034b4f tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00bd48f8f6d4a2fa23aca557ce7cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0063fd85b78e44b982c319f653962203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:32:34.350825 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-ca41dae0-3e90-4bd2-93c7-f9663b034b4f tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8" status: 200 len: 1755 microversion: 2.1 time: 0.168330 Aug 03 19:32:34.351431 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 565/1133] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:32:34 2022] GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:32:35.372548 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-8c574d70-fd78-4be6-b1e4-cbd2d0bf1938 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:32:35.373230 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-8c574d70-fd78-4be6-b1e4-cbd2d0bf1938 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:32:35.381164 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8c574d70-fd78-4be6-b1e4-cbd2d0bf1938 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:32:35.381700 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8c574d70-fd78-4be6-b1e4-cbd2d0bf1938 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:32:35.382366 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8c574d70-fd78-4be6-b1e4-cbd2d0bf1938 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:32:35.382795 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8c574d70-fd78-4be6-b1e4-cbd2d0bf1938 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:32:35.536408 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-8c574d70-fd78-4be6-b1e4-cbd2d0bf1938 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00bd48f8f6d4a2fa23aca557ce7cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0063fd85b78e44b982c319f653962203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:32:35.545322 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-8c574d70-fd78-4be6-b1e4-cbd2d0bf1938 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8" status: 200 len: 1755 microversion: 2.1 time: 0.176498 Aug 03 19:32:35.545905 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 569/1134] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:32:35 2022] GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8 => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:32:36.569484 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-453d70b4-503f-4456-944d-9193eb1eed36 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:32:36.570092 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-453d70b4-503f-4456-944d-9193eb1eed36 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:32:36.577494 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-453d70b4-503f-4456-944d-9193eb1eed36 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:32:36.577937 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-453d70b4-503f-4456-944d-9193eb1eed36 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:32:36.578702 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-453d70b4-503f-4456-944d-9193eb1eed36 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:32:36.579178 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-453d70b4-503f-4456-944d-9193eb1eed36 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:32:36.732457 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-453d70b4-503f-4456-944d-9193eb1eed36 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00bd48f8f6d4a2fa23aca557ce7cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0063fd85b78e44b982c319f653962203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:32:36.740516 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-453d70b4-503f-4456-944d-9193eb1eed36 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8" status: 200 len: 1755 microversion: 2.1 time: 0.175697 Aug 03 19:32:36.741088 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 566/1135] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:32:36 2022] GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8 => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:32:37.763405 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-829df621-1aef-43dc-89d0-8822c00023b0 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:32:37.764340 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-829df621-1aef-43dc-89d0-8822c00023b0 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:32:37.772436 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-829df621-1aef-43dc-89d0-8822c00023b0 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:32:37.772929 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-829df621-1aef-43dc-89d0-8822c00023b0 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:32:37.773824 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-829df621-1aef-43dc-89d0-8822c00023b0 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:32:37.774264 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-829df621-1aef-43dc-89d0-8822c00023b0 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:32:37.944063 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-829df621-1aef-43dc-89d0-8822c00023b0 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00bd48f8f6d4a2fa23aca557ce7cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0063fd85b78e44b982c319f653962203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:32:37.952603 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-829df621-1aef-43dc-89d0-8822c00023b0 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8" status: 200 len: 1755 microversion: 2.1 time: 0.194014 Aug 03 19:32:37.953176 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 570/1136] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:32:37 2022] GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8 => generated 1755 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:32:38.976196 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-472cbc7b-039d-4ee6-b613-ddfcda52ba47 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:32:38.976792 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-472cbc7b-039d-4ee6-b613-ddfcda52ba47 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:32:38.983988 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-472cbc7b-039d-4ee6-b613-ddfcda52ba47 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:32:38.988049 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-472cbc7b-039d-4ee6-b613-ddfcda52ba47 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:32:38.988049 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-472cbc7b-039d-4ee6-b613-ddfcda52ba47 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:32:38.988049 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-472cbc7b-039d-4ee6-b613-ddfcda52ba47 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:32:39.133328 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-472cbc7b-039d-4ee6-b613-ddfcda52ba47 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00bd48f8f6d4a2fa23aca557ce7cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0063fd85b78e44b982c319f653962203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:32:39.141333 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-472cbc7b-039d-4ee6-b613-ddfcda52ba47 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8" status: 200 len: 1755 microversion: 2.1 time: 0.170083 Aug 03 19:32:39.141904 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 567/1137] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:32:38 2022] GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:32:40.161933 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-8ae70295-d0ae-4bdb-8507-137a224f24c3 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:32:40.162626 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-8ae70295-d0ae-4bdb-8507-137a224f24c3 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:32:40.169269 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8ae70295-d0ae-4bdb-8507-137a224f24c3 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:32:40.169716 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8ae70295-d0ae-4bdb-8507-137a224f24c3 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:32:40.170488 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8ae70295-d0ae-4bdb-8507-137a224f24c3 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:32:40.170917 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-8ae70295-d0ae-4bdb-8507-137a224f24c3 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:32:40.322551 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-8ae70295-d0ae-4bdb-8507-137a224f24c3 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00bd48f8f6d4a2fa23aca557ce7cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0063fd85b78e44b982c319f653962203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:32:40.330917 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-8ae70295-d0ae-4bdb-8507-137a224f24c3 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8" status: 200 len: 1755 microversion: 2.1 time: 0.173095 Aug 03 19:32:40.331503 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 571/1138] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:32:40 2022] GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8 => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:32:41.353016 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-219912e7-f85e-48b2-a2f1-440f003fa7cb tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:32:41.353609 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-219912e7-f85e-48b2-a2f1-440f003fa7cb tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:32:41.360244 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-219912e7-f85e-48b2-a2f1-440f003fa7cb tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:32:41.360694 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-219912e7-f85e-48b2-a2f1-440f003fa7cb tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:32:41.361459 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-219912e7-f85e-48b2-a2f1-440f003fa7cb tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:32:41.361898 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-219912e7-f85e-48b2-a2f1-440f003fa7cb tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:32:41.508411 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-219912e7-f85e-48b2-a2f1-440f003fa7cb tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00bd48f8f6d4a2fa23aca557ce7cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0063fd85b78e44b982c319f653962203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:32:41.516505 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-219912e7-f85e-48b2-a2f1-440f003fa7cb tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8" status: 200 len: 1758 microversion: 2.1 time: 0.167412 Aug 03 19:32:41.517071 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 568/1139] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:32:41 2022] GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:33:06.555615 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 19:33:06.556358 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Wed Aug 3 19:33:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 19:33:30.550257 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 19:33:30.550257 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Wed Aug 3 19:33:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 19:33:44.791149 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_api:SELECT=12 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:33:44.791908 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG dbcounter [-] [118303] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:33:44.795926 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-d73b390f-6d9f-4f84-8091-1d5504eff617 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-530965985"}} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:33:44.796639 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-d73b390f-6d9f-4f84-8091-1d5504eff617 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:33:44.803697 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d73b390f-6d9f-4f84-8091-1d5504eff617 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:33:44.804236 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d73b390f-6d9f-4f84-8091-1d5504eff617 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:33:44.805019 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d73b390f-6d9f-4f84-8091-1d5504eff617 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:33:44.805457 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-d73b390f-6d9f-4f84-8091-1d5504eff617 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:33:44.942298 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.network.security_group_api [None req-d73b390f-6d9f-4f84-8091-1d5504eff617 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Removing security group 60d6d02d-1e95-4c1e-b1c3-710f18f2a447 from port 60fd94e5-b5fb-4414-b41b-7cd0f629d165 Aug 03 19:33:45.319805 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-d73b390f-6d9f-4f84-8091-1d5504eff617 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "POST /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8/action" status: 202 len: 0 microversion: 2.1 time: 0.524670 Aug 03 19:33:45.319805 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 572/1140] 10.222.0.77 () {60 vars in 1278 bytes} [Wed Aug 3 19:33:44 2022] POST /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8/action => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 19:33:45.320720 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_api:SELECT=12 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:33:45.321508 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG dbcounter [-] [118302] Writing DB stats nova_cell1:SELECT=36 {{(pid=118302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:33:45.328931 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [req-44d13090-a202-4c3c-9309-394572a09431 req-e82959d3-5fbf-46d6-92ed-27ac7b3216bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c73ab949-c9f1-4152-a9f1-84a503833fc8", "tag": "60fd94e5-b5fb-4414-b41b-7cd0f629d165"}]} {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:33:45.341855 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-44d13090-a202-4c3c-9309-394572a09431 req-e82959d3-5fbf-46d6-92ed-27ac7b3216bb service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:33:45.341982 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [req-44d13090-a202-4c3c-9309-394572a09431 req-e82959d3-5fbf-46d6-92ed-27ac7b3216bb service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:33:45.357492 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.compute.server_external_events [req-44d13090-a202-4c3c-9309-394572a09431 req-e82959d3-5fbf-46d6-92ed-27ac7b3216bb service nova] Creating event network-changed:60fd94e5-b5fb-4414-b41b-7cd0f629d165 for instance c73ab949-c9f1-4152-a9f1-84a503833fc8 on hv-cinder-85202 Aug 03 19:33:45.365721 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [req-44d13090-a202-4c3c-9309-394572a09431 req-e82959d3-5fbf-46d6-92ed-27ac7b3216bb service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046349 Aug 03 19:33:45.367127 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 569/1141] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:33:46.866645 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-311cc024-78df-4fe5-aad9-06b32a0e608a tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:33:46.867262 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-311cc024-78df-4fe5-aad9-06b32a0e608a tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:33:46.873421 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-311cc024-78df-4fe5-aad9-06b32a0e608a tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:33:46.873865 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-311cc024-78df-4fe5-aad9-06b32a0e608a tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:33:46.874624 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-311cc024-78df-4fe5-aad9-06b32a0e608a tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:33:46.875084 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-311cc024-78df-4fe5-aad9-06b32a0e608a tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:33:46.961952 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.objects.instance [None req-311cc024-78df-4fe5-aad9-06b32a0e608a tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lazy-loading 'services' on Instance uuid c73ab949-c9f1-4152-a9f1-84a503833fc8 {{(pid=118303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:33:47.214545 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-311cc024-78df-4fe5-aad9-06b32a0e608a tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "DELETE /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8/os-volume_attachments/18afccc5-e8ce-4fba-ae50-033e042bba60" status: 202 len: 0 microversion: 2.1 time: 0.352473 Aug 03 19:33:47.215174 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 573/1142] 10.222.0.77 () {58 vars in 1416 bytes} [Wed Aug 3 19:33:46 2022] DELETE /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8/os-volume_attachments/18afccc5-e8ce-4fba-ae50-033e042bba60 => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 19:33:47.224050 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-ce39df49-8630-4aa1-b40b-f6281a87a022 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:33:47.227091 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-ce39df49-8630-4aa1-b40b-f6281a87a022 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:33:47.236352 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ce39df49-8630-4aa1-b40b-f6281a87a022 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:33:47.237035 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ce39df49-8630-4aa1-b40b-f6281a87a022 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:33:47.237840 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ce39df49-8630-4aa1-b40b-f6281a87a022 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:33:47.238302 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ce39df49-8630-4aa1-b40b-f6281a87a022 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:33:47.269504 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-ce39df49-8630-4aa1-b40b-f6281a87a022 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049665 Aug 03 19:33:47.270180 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 570/1143] 10.222.0.77 () {58 vars in 1302 bytes} [Wed Aug 3 19:33:47 2022] GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:33:47.382238 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [req-d8581192-76c4-4185-9edb-caae67c2ad74 req-eeef839c-0a04-404f-b797-13d7c37e8fbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c73ab949-c9f1-4152-a9f1-84a503833fc8", "tag": "60fd94e5-b5fb-4414-b41b-7cd0f629d165"}]} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:33:47.392632 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-d8581192-76c4-4185-9edb-caae67c2ad74 req-eeef839c-0a04-404f-b797-13d7c37e8fbe service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:33:47.393087 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-d8581192-76c4-4185-9edb-caae67c2ad74 req-eeef839c-0a04-404f-b797-13d7c37e8fbe service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:33:47.405124 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.compute.server_external_events [req-d8581192-76c4-4185-9edb-caae67c2ad74 req-eeef839c-0a04-404f-b797-13d7c37e8fbe service nova] Creating event network-changed:60fd94e5-b5fb-4414-b41b-7cd0f629d165 for instance c73ab949-c9f1-4152-a9f1-84a503833fc8 on hv-cinder-85202 Aug 03 19:33:47.410187 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [req-d8581192-76c4-4185-9edb-caae67c2ad74 req-eeef839c-0a04-404f-b797-13d7c37e8fbe service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032683 Aug 03 19:33:47.410780 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 574/1144] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:33:48.282251 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-9a5b0adf-e12f-483b-b43a-7b60ca27fc67 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:33:48.284638 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-9a5b0adf-e12f-483b-b43a-7b60ca27fc67 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:33:48.292556 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9a5b0adf-e12f-483b-b43a-7b60ca27fc67 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:33:48.293027 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9a5b0adf-e12f-483b-b43a-7b60ca27fc67 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:33:48.293858 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9a5b0adf-e12f-483b-b43a-7b60ca27fc67 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:33:48.294338 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-9a5b0adf-e12f-483b-b43a-7b60ca27fc67 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:33:48.324408 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-9a5b0adf-e12f-483b-b43a-7b60ca27fc67 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046232 Aug 03 19:33:48.325183 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 571/1145] 10.222.0.77 () {58 vars in 1302 bytes} [Wed Aug 3 19:33:48 2022] GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:33:49.341242 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-60dc412a-16a3-4a1b-8bf6-940576c74a3d tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:33:49.345165 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-60dc412a-16a3-4a1b-8bf6-940576c74a3d tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:33:49.352598 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-60dc412a-16a3-4a1b-8bf6-940576c74a3d tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:33:49.353044 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-60dc412a-16a3-4a1b-8bf6-940576c74a3d tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:33:49.353816 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-60dc412a-16a3-4a1b-8bf6-940576c74a3d tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:33:49.354277 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-60dc412a-16a3-4a1b-8bf6-940576c74a3d tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:33:49.387654 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-60dc412a-16a3-4a1b-8bf6-940576c74a3d tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054275 Aug 03 19:33:49.388218 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 575/1146] 10.222.0.77 () {58 vars in 1302 bytes} [Wed Aug 3 19:33:49 2022] GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 03 19:33:49.401555 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-1f36d56d-59d2-46e0-801e-982fdc09e5e7 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:33:49.402557 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-1f36d56d-59d2-46e0-801e-982fdc09e5e7 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:33:49.408647 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1f36d56d-59d2-46e0-801e-982fdc09e5e7 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:33:49.409091 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1f36d56d-59d2-46e0-801e-982fdc09e5e7 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:33:49.409857 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1f36d56d-59d2-46e0-801e-982fdc09e5e7 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:33:49.410294 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-1f36d56d-59d2-46e0-801e-982fdc09e5e7 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:33:49.492565 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.wsgi [None req-1f36d56d-59d2-46e0-801e-982fdc09e5e7 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] HTTP exception thrown: Instance c73ab949-c9f1-4152-a9f1-84a503833fc8 is not attached to volume 18afccc5-e8ce-4fba-ae50-033e042bba60 Aug 03 19:33:49.494902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-1f36d56d-59d2-46e0-801e-982fdc09e5e7 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Request method failure captured: Aug 03 19:33:49.494902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: request: DELETE /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8/os-volume_attachments/18afccc5-e8ce-4fba-ae50-033e042bba60 HTTP/1.1 Aug 03 19:33:49.494902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept: application/json Aug 03 19:33:49.494902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Accept-Encoding: identity Aug 03 19:33:49.494902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Connection: close Aug 03 19:33:49.494902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Length: 0 Aug 03 19:33:49.494902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Content-Type: application/json Aug 03 19:33:49.494902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Host: 10.222.0.77 Aug 03 19:33:49.494902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Openstack-System-Scope: None Aug 03 19:33:49.494902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: User-Agent: python-urllib3/1.26.11 Aug 03 19:33:49.494902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Auth-Token: gAAAAABi6szblGQlfQ0juNWb4BnEl9V5ahjwuVil8QVWSDTz0jNCxgCYyyGbCtexMFkIXDqZo3Q_ofHd2RAMMK_p-66kjbKGM4PQnZZj0kvMQBV19RLgylOd71VgJ4bEznVSnudH3Xwc34F_mpo8wX_zZv2omM9KT-R6J5iEibVnGKa3VOjVeTk Aug 03 19:33:49.494902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Id: None Aug 03 19:33:49.494902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Domain-Name: None Aug 03 19:33:49.494902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Identity-Status: Confirmed Aug 03 19:33:49.494902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Is-Admin-Project: True Aug 03 19:33:49.494902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Id: default Aug 03 19:33:49.494902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Domain-Name: Default Aug 03 19:33:49.494902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Id: 0063fd85b78e44b982c319f653962203 Aug 03 19:33:49.494902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Project-Name: tempest-TestMinimumBasicScenario-970740246 Aug 03 19:33:49.494902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Role: reader,member Aug 03 19:33:49.494902 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Roles: reader,member Aug 03 19:33:49.496792 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_0063fd85b78e44b982c319f653962203", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/0063fd85b78e44b982c319f653962203"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/0063fd85b78e44b982c319f653962203"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/0063fd85b78e44b982c319f653962203"}]}] Aug 03 19:33:49.496792 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant: tempest-TestMinimumBasicScenario-970740246 Aug 03 19:33:49.496792 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Id: 0063fd85b78e44b982c319f653962203 Aug 03 19:33:49.496792 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-Tenant-Name: tempest-TestMinimumBasicScenario-970740246 Aug 03 19:33:49.496792 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User: tempest-TestMinimumBasicScenario-970740246-project Aug 03 19:33:49.496792 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Id: default Aug 03 19:33:49.496792 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Domain-Name: Default Aug 03 19:33:49.496792 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Id: f00bd48f8f6d4a2fa23aca557ce7cec2 Aug 03 19:33:49.496792 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: X-User-Name: tempest-TestMinimumBasicScenario-970740246-project Aug 03 19:33:49.496792 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: method: > Aug 03 19:33:49.496792 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: exception: Instance c73ab949-c9f1-4152-a9f1-84a503833fc8 is not attached to volume 18afccc5-e8ce-4fba-ae50-033e042bba60 Aug 03 19:33:49.497913 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: action_args: {'server_id': 'c73ab949-c9f1-4152-a9f1-84a503833fc8', 'id': '18afccc5-e8ce-4fba-ae50-033e042bba60'} Aug 03 19:33:49.497913 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:33:49.497913 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:33:49.497913 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 03 19:33:49.497913 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 03 19:33:49.497913 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 19:33:49.497913 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 19:33:49.497913 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 03 19:33:49.497913 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 03 19:33:49.497913 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 18afccc5-e8ce-4fba-ae50-033e042bba60. Aug 03 19:33:49.497913 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:33:49.497913 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:33:49.497913 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:33:49.497913 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:33:49.497913 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:33:49.497913 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:33:49.497913 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:33:49.497913 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:33:49.497913 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:33:49.499604 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:33:49.499604 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 03 19:33:49.499604 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 03 19:33:49.499604 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c73ab949-c9f1-4152-a9f1-84a503833fc8 is not attached to volume 18afccc5-e8ce-4fba-ae50-033e042bba60 Aug 03 19:33:49.499604 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:33:49.499604 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:33:49.499604 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:33:49.499604 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:33:49.499604 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:33:49.499604 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:33:49.499604 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:33:49.499604 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:33:49.499604 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c73ab949-c9f1-4152-a9f1-84a503833fc8 is not attached to volume 18afccc5-e8ce-4fba-ae50-033e042bba60 Aug 03 19:33:49.499604 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: ERROR nova.api.openstack.wsgi Aug 03 19:33:49.499604 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-1f36d56d-59d2-46e0-801e-982fdc09e5e7 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Returning 404 to user: Instance c73ab949-c9f1-4152-a9f1-84a503833fc8 is not attached to volume 18afccc5-e8ce-4fba-ae50-033e042bba60 {{(pid=118302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:33:49.501543 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-1f36d56d-59d2-46e0-801e-982fdc09e5e7 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "DELETE /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8/os-volume_attachments/18afccc5-e8ce-4fba-ae50-033e042bba60" status: 404 len: 154 microversion: 2.1 time: 0.100523 Aug 03 19:33:49.501543 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 572/1147] 10.222.0.77 () {58 vars in 1416 bytes} [Wed Aug 3 19:33:49 2022] DELETE /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8/os-volume_attachments/18afccc5-e8ce-4fba-ae50-033e042bba60 => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:33:50.779453 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-239ae899-f48c-4e79-bf17-7caf8482415b tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:33:50.779988 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-239ae899-f48c-4e79-bf17-7caf8482415b tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:33:50.786699 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-239ae899-f48c-4e79-bf17-7caf8482415b tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:33:50.787713 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-239ae899-f48c-4e79-bf17-7caf8482415b tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:33:50.788497 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-239ae899-f48c-4e79-bf17-7caf8482415b tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:33:50.788939 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-239ae899-f48c-4e79-bf17-7caf8482415b tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:33:50.814675 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-239ae899-f48c-4e79-bf17-7caf8482415b tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Going to try to terminate instance {{(pid=118303) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 19:33:51.071289 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-239ae899-f48c-4e79-bf17-7caf8482415b tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "DELETE /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8" status: 204 len: 0 microversion: 2.1 time: 0.295256 Aug 03 19:33:51.071779 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 576/1148] 10.222.0.77 () {58 vars in 1239 bytes} [Wed Aug 3 19:33:50 2022] DELETE /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 19:33:51.080703 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-ae8488d4-6714-4db0-8350-38c013d8a698 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:33:51.081479 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-ae8488d4-6714-4db0-8350-38c013d8a698 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:33:51.088901 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ae8488d4-6714-4db0-8350-38c013d8a698 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:33:51.089353 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ae8488d4-6714-4db0-8350-38c013d8a698 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:33:51.090125 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ae8488d4-6714-4db0-8350-38c013d8a698 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:33:51.090566 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-ae8488d4-6714-4db0-8350-38c013d8a698 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:33:51.232481 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-ae8488d4-6714-4db0-8350-38c013d8a698 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00bd48f8f6d4a2fa23aca557ce7cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0063fd85b78e44b982c319f653962203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:33:51.240173 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-ae8488d4-6714-4db0-8350-38c013d8a698 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8" status: 200 len: 1553 microversion: 2.1 time: 0.163910 Aug 03 19:33:51.240992 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 573/1149] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:33:51 2022] GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8 => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:33:52.262651 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-ee0be2ca-c8ba-4e1f-8d01-dbfccd276f23 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:33:52.263401 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-ee0be2ca-c8ba-4e1f-8d01-dbfccd276f23 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:33:52.270206 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ee0be2ca-c8ba-4e1f-8d01-dbfccd276f23 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:33:52.270657 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ee0be2ca-c8ba-4e1f-8d01-dbfccd276f23 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:33:52.271503 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ee0be2ca-c8ba-4e1f-8d01-dbfccd276f23 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:33:52.271984 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-ee0be2ca-c8ba-4e1f-8d01-dbfccd276f23 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:33:52.410269 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.policy [None req-ee0be2ca-c8ba-4e1f-8d01-dbfccd276f23 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00bd48f8f6d4a2fa23aca557ce7cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0063fd85b78e44b982c319f653962203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118303) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:33:52.418523 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-ee0be2ca-c8ba-4e1f-8d01-dbfccd276f23 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8" status: 200 len: 1553 microversion: 2.1 time: 0.160114 Aug 03 19:33:52.419117 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 577/1150] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:33:52 2022] GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8 => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:33:53.440291 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-4222ed1a-89fb-4772-a11d-e77d75a0fc76 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:33:53.440900 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-4222ed1a-89fb-4772-a11d-e77d75a0fc76 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:33:53.448691 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4222ed1a-89fb-4772-a11d-e77d75a0fc76 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:33:53.449135 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4222ed1a-89fb-4772-a11d-e77d75a0fc76 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:33:53.449909 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4222ed1a-89fb-4772-a11d-e77d75a0fc76 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:33:53.450340 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-4222ed1a-89fb-4772-a11d-e77d75a0fc76 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:33:53.591318 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-4222ed1a-89fb-4772-a11d-e77d75a0fc76 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00bd48f8f6d4a2fa23aca557ce7cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0063fd85b78e44b982c319f653962203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:33:53.600037 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-4222ed1a-89fb-4772-a11d-e77d75a0fc76 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8" status: 200 len: 1553 microversion: 2.1 time: 0.163568 Aug 03 19:33:53.600622 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 574/1151] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:33:53 2022] GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8 => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:33:53.815289 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [req-8cbaa915-0a65-4d99-988e-fa1505a012b1 req-9989a2bc-dcbd-49a8-aaa1-0fbf08d2e3f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c73ab949-c9f1-4152-a9f1-84a503833fc8", "name": "network-vif-deleted", "tag": "60fd94e5-b5fb-4414-b41b-7cd0f629d165"}]} {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:33:53.825188 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-8cbaa915-0a65-4d99-988e-fa1505a012b1 req-9989a2bc-dcbd-49a8-aaa1-0fbf08d2e3f2 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:33:53.825631 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [req-8cbaa915-0a65-4d99-988e-fa1505a012b1 req-9989a2bc-dcbd-49a8-aaa1-0fbf08d2e3f2 service nova] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:33:53.837924 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.compute.server_external_events [req-8cbaa915-0a65-4d99-988e-fa1505a012b1 req-9989a2bc-dcbd-49a8-aaa1-0fbf08d2e3f2 service nova] Creating event network-vif-deleted:60fd94e5-b5fb-4414-b41b-7cd0f629d165 for instance c73ab949-c9f1-4152-a9f1-84a503833fc8 on hv-cinder-85202 Aug 03 19:33:53.843026 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [req-8cbaa915-0a65-4d99-988e-fa1505a012b1 req-9989a2bc-dcbd-49a8-aaa1-0fbf08d2e3f2 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031411 Aug 03 19:33:53.843580 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 578/1152] 10.222.0.77 () {64 vars in 1317 bytes} [Wed Aug 3 19:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:33:54.621345 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-7b2eb79f-e006-4186-b876-35f0b3a2f8c2 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:33:54.621951 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.compute.api [None req-7b2eb79f-e006-4186-b876-35f0b3a2f8c2 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118302) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:33:54.628374 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7b2eb79f-e006-4186-b876-35f0b3a2f8c2 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:33:54.628823 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7b2eb79f-e006-4186-b876-35f0b3a2f8c2 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:33:54.629715 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7b2eb79f-e006-4186-b876-35f0b3a2f8c2 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:33:54.630080 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7b2eb79f-e006-4186-b876-35f0b3a2f8c2 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:33:54.672922 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7b2eb79f-e006-4186-b876-35f0b3a2f8c2 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:33:54.673376 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG oslo_concurrency.lockutils [None req-7b2eb79f-e006-4186-b876-35f0b3a2f8c2 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:33:54.673827 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.objects.instance [None req-7b2eb79f-e006-4186-b876-35f0b3a2f8c2 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lazy-loading 'fault' on Instance uuid c73ab949-c9f1-4152-a9f1-84a503833fc8 {{(pid=118302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:33:54.717087 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.policy [None req-7b2eb79f-e006-4186-b876-35f0b3a2f8c2 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00bd48f8f6d4a2fa23aca557ce7cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0063fd85b78e44b982c319f653962203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118302) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:33:54.725256 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-7b2eb79f-e006-4186-b876-35f0b3a2f8c2 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8" status: 200 len: 1347 microversion: 2.1 time: 0.107711 Aug 03 19:33:54.725841 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 575/1153] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:33:54 2022] GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8 => generated 1347 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:33:55.747110 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-f3b177de-bb57-4f45-85e3-256f99e3a0d3 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '>' {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:33:55.747811 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.compute.api [None req-f3b177de-bb57-4f45-85e3-256f99e3a0d3 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] [instance: c73ab949-c9f1-4152-a9f1-84a503833fc8] Fetching instance by UUID {{(pid=118303) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:33:55.754189 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f3b177de-bb57-4f45-85e3-256f99e3a0d3 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:33:55.754631 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f3b177de-bb57-4f45-85e3-256f99e3a0d3 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:33:55.755420 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f3b177de-bb57-4f45-85e3-256f99e3a0d3 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:33:55.755858 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG oslo_concurrency.lockutils [None req-f3b177de-bb57-4f45-85e3-256f99e3a0d3 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Lock "68a582b5-bf89-4c4b-b661-ad002d2788a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:33:55.770565 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.wsgi [None req-f3b177de-bb57-4f45-85e3-256f99e3a0d3 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] HTTP exception thrown: Instance c73ab949-c9f1-4152-a9f1-84a503833fc8 could not be found. Aug 03 19:33:55.772814 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-f3b177de-bb57-4f45-85e3-256f99e3a0d3 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Request method failure captured: Aug 03 19:33:55.772814 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: request: GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8 HTTP/1.1 Aug 03 19:33:55.772814 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept: application/json Aug 03 19:33:55.772814 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Accept-Encoding: identity Aug 03 19:33:55.772814 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Connection: close Aug 03 19:33:55.772814 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Length: 0 Aug 03 19:33:55.772814 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Content-Type: application/json Aug 03 19:33:55.772814 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Host: 10.222.0.77 Aug 03 19:33:55.772814 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Openstack-System-Scope: None Aug 03 19:33:55.772814 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: User-Agent: python-urllib3/1.26.11 Aug 03 19:33:55.772814 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Auth-Token: gAAAAABi6szblGQlfQ0juNWb4BnEl9V5ahjwuVil8QVWSDTz0jNCxgCYyyGbCtexMFkIXDqZo3Q_ofHd2RAMMK_p-66kjbKGM4PQnZZj0kvMQBV19RLgylOd71VgJ4bEznVSnudH3Xwc34F_mpo8wX_zZv2omM9KT-R6J5iEibVnGKa3VOjVeTk Aug 03 19:33:55.772814 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Id: None Aug 03 19:33:55.772814 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Domain-Name: None Aug 03 19:33:55.772814 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Identity-Status: Confirmed Aug 03 19:33:55.772814 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Is-Admin-Project: True Aug 03 19:33:55.772814 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Id: default Aug 03 19:33:55.772814 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Domain-Name: Default Aug 03 19:33:55.772814 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Id: 0063fd85b78e44b982c319f653962203 Aug 03 19:33:55.772814 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Project-Name: tempest-TestMinimumBasicScenario-970740246 Aug 03 19:33:55.772814 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Role: reader,member Aug 03 19:33:55.772814 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Roles: reader,member Aug 03 19:33:55.774603 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_0063fd85b78e44b982c319f653962203", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/0063fd85b78e44b982c319f653962203"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/0063fd85b78e44b982c319f653962203"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/0063fd85b78e44b982c319f653962203"}]}] Aug 03 19:33:55.774603 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant: tempest-TestMinimumBasicScenario-970740246 Aug 03 19:33:55.774603 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Id: 0063fd85b78e44b982c319f653962203 Aug 03 19:33:55.774603 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-Tenant-Name: tempest-TestMinimumBasicScenario-970740246 Aug 03 19:33:55.774603 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User: tempest-TestMinimumBasicScenario-970740246-project Aug 03 19:33:55.774603 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Id: default Aug 03 19:33:55.774603 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Domain-Name: Default Aug 03 19:33:55.774603 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Id: f00bd48f8f6d4a2fa23aca557ce7cec2 Aug 03 19:33:55.774603 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: X-User-Name: tempest-TestMinimumBasicScenario-970740246-project Aug 03 19:33:55.774603 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: method: > Aug 03 19:33:55.774603 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: exception: Instance c73ab949-c9f1-4152-a9f1-84a503833fc8 could not be found. Aug 03 19:33:55.774603 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: action_args: {'id': 'c73ab949-c9f1-4152-a9f1-84a503833fc8'} Aug 03 19:33:55.775670 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: {{(pid=118303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:33:55.775670 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:33:55.775670 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:33:55.775670 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:33:55.775670 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:33:55.775670 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:33:55.775670 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:33:55.775670 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:33:55.775670 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:33:55.775670 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:33:55.775670 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c73ab949-c9f1-4152-a9f1-84a503833fc8 could not be found. Aug 03 19:33:55.775670 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:33:55.775670 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:33:55.775670 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:33:55.775670 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:33:55.775670 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:33:55.775670 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:33:55.775670 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:33:55.775670 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:33:55.775670 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:33:55.777460 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:33:55.777460 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:33:55.777460 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:33:55.777460 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:33:55.777460 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:33:55.777460 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:33:55.777460 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:33:55.777460 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c73ab949-c9f1-4152-a9f1-84a503833fc8 could not be found. Aug 03 19:33:55.777460 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:33:55.777460 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:33:55.777460 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:33:55.777460 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:33:55.777460 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:33:55.777460 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:33:55.777460 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:33:55.777460 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:33:55.777460 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c73ab949-c9f1-4152-a9f1-84a503833fc8 could not be found. Aug 03 19:33:55.777460 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: ERROR nova.api.openstack.wsgi Aug 03 19:33:55.779208 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: DEBUG nova.api.openstack.wsgi [None req-f3b177de-bb57-4f45-85e3-256f99e3a0d3 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Returning 404 to user: Instance c73ab949-c9f1-4152-a9f1-84a503833fc8 could not be found. {{(pid=118303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:33:55.779208 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO nova.api.openstack.requestlog [None req-f3b177de-bb57-4f45-85e3-256f99e3a0d3 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8" status: 404 len: 111 microversion: 2.1 time: 0.032114 Aug 03 19:33:55.779208 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: [pid: 118303|app: 0|req: 579/1154] 10.222.0.77 () {58 vars in 1236 bytes} [Wed Aug 3 19:33:55 2022] GET /compute/v2.1/servers/c73ab949-c9f1-4152-a9f1-84a503833fc8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:33:55.783275 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: DEBUG nova.api.openstack.wsgi [None req-cf1ef4ce-89c7-46e4-a66d-9c3ea1deb534 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] Calling method '.version_select at 0x7f4786090f70>' {{(pid=118302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:33:55.860705 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO nova.api.openstack.requestlog [None req-cf1ef4ce-89c7-46e4-a66d-9c3ea1deb534 tempest-TestMinimumBasicScenario-970740246 tempest-TestMinimumBasicScenario-970740246-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-257815558" status: 202 len: 0 microversion: 2.1 time: 0.081234 Aug 03 19:33:55.861288 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: [pid: 118302|app: 0|req: 576/1155] 10.222.0.77 () {58 vars in 1269 bytes} [Wed Aug 3 19:33:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-257815558 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 19:34:48.223312 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 19:34:48.224407 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Wed Aug 3 19:34:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 19:36:26.565663 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 19:36:26.566277 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Wed Aug 3 19:36:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 19:36:30.351584 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 19:36:30.352273 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Wed Aug 3 19:36:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 19:36:50.558161 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 19:36:50.558776 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Wed Aug 3 19:36:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 19:37:00.163315 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 19:37:00.163966 dv-cinder-852024-1-iscsi devstack@n-api.service[118303]: Wed Aug 3 19:37:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 19:38:08.232824 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 19:38:08.233518 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Wed Aug 3 19:38:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 19:39:23.256331 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 19:39:23.256955 dv-cinder-852024-1-iscsi devstack@n-api.service[118302]: Wed Aug 3 19:39:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!